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PREFACE 


This book is based on the lectures read by authors at Moscow 
State University for a number of years, 

As in Part 1, the authors strived to make presentation systematic 
avd to set off the most important notions and theorems, 

Besides the basic curriculum material, this book contains some 
additional questions that play au important part in various branches 
of modern mathematics and physics (the theory of measure and 
Lebesgue integrals, the theory of Hilbert spaces and of self-adjoint 
linear operators in these spaces, questions of regularization of Fourier 
series, the theory of differentia] forms in Euclidean spaces, etc.). 
Some of the topics, such as the conditions for termwise differentiation 
and termwise integration of functional sequences and functional 
series, the theorem on the change of variables in a multiple integral, 
Green’s and Stokes’s formulas, necessary conditions for a bounded 
function-to be integrable in the sense of Riemann and in the sense of 
Lebesgue, are treated more generally and under weaker assumptions 
than usual. 

As in Part 4, we discuss in this book some questions related to 
computational mathematics, including first of all approximate cale 
culation of multiple integrals in the supplement to Chapter 2 and 
calculation of the values of functions from the approximate values 
of Fourier coefficients (A.N. Tichonoff’s regularization method) 
in the Appendix. 

The material of this book, together with that of Part 4 published 
earlier, constitutes an entire university course in mathematical 
analysis. 

Note that throughout this text Part 1 is referred to as Volume 4 
and designated [4]. It should also be stressed that when reading this 
book Chapter 8, The Lebesgue Integral and Measure, Chapter 11, 
Hilbert Space, and all the supplements may be skipped without 
impairing the understanding of the rest of the text. 
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The authors feel deeply indebted to A.N. Tichonoff and A.G.'Svesh- 
nikoy for much valuable advice and numerous profound criticisms, 
to Sh.A. Alimov, who has dono more than just editing this book, 
to L.D. Kudryavtsev and S.A. Lomov fora great number of valuable 
criticisms, to P.S. Modenoy and Ya.M. Zhiloikin, who have mado 
available to the authors materials on field theory and approximate 


methods of evaluating multiple integrals. 
V. flyin, BE. Posnyak 
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CHAPTER 14 


FUNCTIONAL SEQUENCES 
AND FUNCTIONAL SERIES 


In this chapter we shall] study sequences and series whose members 
are not numbers but functions defined on some given set. Such 
Sequences and series are widely used to represent the functions and 
to compute them approximately. 


1.4. UNIFORM CONVERGENCE 


1.1.1. The functional sequence and the functional series. Let {zx} 
be some set*. Then, if we assign to each n of the natural numbers1,2,... 
..e3,... by a definite rule some function f, (x) defined on {zx}, the 
set of the numbered functions f, (z), fo (z), - - +» fn (Z)) -- » is said to 
be a funetional sequence. 

The individual functions f, (z) are called members or elements of 
the sequence, and {x} is its domain of definition or simply domain. 

The symbol {f, (z)} will be used to designate a functional sequence. 

The formally written sum 


Dy, Un (@) = Uy (2) +z (2) oe Un (2)-F oe (1.4) 
of an infinite number of elements of a functional sequence {u, (z)} 
will be called a functional series. 

The terms uw, (z) of that series are functions defined on some set {z}. 

The set {z} is called the domain of definition, or domain, of the 
functional series (1.1). 

As in the case of the number series, the sum of the first n terms of 
(1.1) are called the nth partial sum of that series. 

It should be stressed that the study of functional series is perfectly 
equivalent to the study of functional sequences, for to every functional 
series (1.4) uniquely corresponds a functional sequence 


Sy (x), So (Zr ooey Sq (Zs oes (4.2) 


* In particular, by {z} we may imply both the set of points of a straight 
line and the set of points z = (z,, 22, - - -; 2m) of a Euclidean space E™. 
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of its partial sums, and, conversely, to every functional sequence 
(1.2) uniquely corresponds a functional series (1.1) with terms 


u, (xz) = Sy (x), Un (z) = Sy (z) — Sn-a (x) for n>2 
for which the sequence (4.2) is a sequence of partial sums. 
Were are examples of functional sequences and series. 


4,(z)| 4x h f(x) 
\ 14 i+ 


o| 12 0 12 1a Of tn tx 
Fig. 1.4 
Example 4. Consider a sequence of functions {f, (x)} each defined 
on the closed interval O< 2 <i and having the form 
; ({1—nz) when 0<2z<i/n, 
In (@)= Q when I/n<a<i. 
Figure 1.4 gives the graphs of the functions jf, (z), f. (z) and fp (2)- 
Example 2. As an example of a functional series consider the fol- 
lowing power Series in x: 


nm 


(1.3) 


aS ee ee an pose 4 
{- amid I+ apt veebaptee. (1.4) 


herd 


Notice that the (n -+ 1)th partial sum of (4.4) differs from the 
Maclaurin expansion of e* only by the remainder term Ry 4, (z). 

1.1.2. Convergence of a functional sequence at a point and on a set. 
Suppose a functional sequence (or series) is defined on a set {z} 
Fix an arbitrary point 2, of {z} and consider all the elements or 
the sequence (or the terms of the series) at zy. We obtain a number 
sequence (or series), 

If this number sequence (or series) converges, the given functional 
sequence (or series) is said fo converge al x9. 

The set of all points 2, at which a given functional sequence (or 
series) converges is called the domain of convergence of that sequence 
for that series). 

At various particular cases the domain of convergence may either 
coincide with the domain of definition or form a part of the domain 
or be an empty sel. 
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Corresponding examples are given below. 

Suppose that {f, (z)} has {z} as the domain of convergence. The 
collection of all limits taken for all the values of x from the set {zx} 
forms a well-defined function f (z) also given on {z}. 

This function is called the limit function of the sequence {f, (x)}. 

Quite similarly, if the functional series (1.1) converges on some 
set {x}, then on that set a function S$ (x) f 
is defined which is the limit function of (2) 
the sequence of its partial sums and is 1 
called the sum of that series. 

The sequence (4.3) of Example 1 above 
converges on the whole of the closed interval 
0O<erx<ti. 

Indeed, f, (0) = 1 for all integers n, 

i.e. at the point <=0 the sequence (1.3) 
converges to unity. Q 1 2 

But if we choose any z in the half-open ; 
interval 0 << x2< 1, then all f, (x) begin- Fig. 1.2 
ning with some integer (dependent of 
course on x) will be zero. At any point z of O<.z< 1 therefore 
(1.38) converges to zero. 

So, (1.3) converges on the entire interval O0< z <1 to a limit 
function f(z) having the form 


: 1 when r=0 
fam | 0 when O<zexcl. 


The graph of that limit function is given in Fig. 41.2. 

We stress that f (z) is not continuous on the interval O<2<1 
(it is discontinuous at x = 0). 

Now we turn to the functional series (1.4) of Example 2. 

That series converges at any point x of an infinite straight line 
and its sum equals e*. For the proof the reader is referred to Chap- 
ter 13 of [4] (see Example 3 in Section 13.1.1)*. 

4.1.3. Uniform convergence on a set. Suppose that a sequence 


fi @)s fa @r ver fa hr oe (1.5) 


converges on a set {z} to a limit function f (2). 

Definition 1. The sequence (4.5) is said to converge to the function 
f (x) uniformly on the set {x} if for any © > 0 we can find an integer 
N (8) such that given n > N (e), for all x of {x} we have** 


| fn (z) — f(x) |<e. (1.6) 


* This proof, however, immediately follows from the Maclaurin formula 

for e~ and from the fact that the remainder in that formula tends to zero for all x. 

** If by {z} we mean a set of points z = (21,..., 2m) of a space E™, then 

we obtain a definition of uniform convergence of a sequence f/f, (x) = 
= fn (21, Lo, - - +: Lm) of functions of m variables. 
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Remark 1, What is very essential to this definition is that .V 
depends only on € and is independent of z. Thus for any ¢ > 0 we 
can find a universal integer NV (e) beginning with which inequality 
(1.5) holds at once for all x of {2}. 

temark 2. 7he convergence of {f,, (x)} on {x} does not at all imply 
tts uniform convergence on {2}. Thus the sequence (1.3) of Example4 
above converges on the entire interval [0, 4] (that was established 
above). 

We now prove that that sequence does not untformly converge on 
{Q, 4]. Consider a sequence of points z, = 1/2n (n = 1, 2, ...) 
belonging to {0, 4]. At each of the points (i.e. for every m) the rela- 
tions f, (rn) = 1/2, 7 (z,) = 0 hold. Thus for any n 


ifn (Ta) — f (tn) | = 1/2, 


ic, when © < 1/2, inequality 4.6) cannot hold for all points z of 
{G. 4J at once, whatever n we have. 

Remark 3. Note that the uniform convergence of {f, (x)} on {x} 
to f (z) is equivalent to the convergence of a number sequence {e,,} 
whose elements ¢€,, are the suprema of the function | f, (z) — f(z)! 
on {7}. 

Remark 4. It is immediate from Definition 4 that if {f, (7)} uni- 
formly converges to f (z) on the whole of {z}, then it docs so on any 
portion of {7}. 

Now we give an example of a functional sequence uniformly con- 
verging on some sel {7}. Consider again the sequence (4.3), this time 
nat on the whole of (@, 1], but on a closed interval [5, 1], where 6 is 
a fixed number in the interval 0<< 6 <4. For any such 6 we can 
find an integer beginning with which all the clements f, (2) are zero 
on {6, 4]. Since the limit function f (z) is also zero on [4, 4], every- 
where on [5, 4] we have | f, (2) — f(z) | <eforanye > O heginning 
with the indicated integer. This proves the uniform convergence of 
(1.3) on [6, 4]. 

Definition 2. A functional series is said to be uniformly convergent 
ona set {x} to its sum S (z) if the sequence {S,, (2)} of tts partial sums 
converges uniformly on {x} to the limit function S (z). 

Prove on your own that the functional series (1.4) of Example 2 
ahove converges to its sum e* uniformly on every interval —r <r < 
<r, where ris any fixed positive number”. 


* Jo prove this it suffices to evaluate the remainder Ryay (x) in the Maclourin 
formula for e%. This remainder, which is the difference between -* and the 
(n+ {Mh partial sum of (1.4), satisfies for all xz in the interval --r 7 x 7 r at 
ance the inequality 


rut 


TRasy I< Ear er 


see formula (8.02) in f1)). 
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1.1.4. Cauchy criterion. The folowing two main theorems hold. 

Theorem 1.1. Fora functional sequence {f, (x)} to converge uniformly 

on a set {x} to some limit function it is necessary and sufficient that for 
any € > 0 we should be able to find N (8) such that 


| fap (x) — fh (x) }<e (1.7) 


for alln >WN (ek), all natural p (p = 1, 2,...) and all x of {zx}, 

Theorem 1.2. For a functional series 

2, al) (1.8) 
to converge uniformly on a set {x} to a certain sum it is necessary and 
sufficient that for any & > 0 we should be able te find N (€) such that 

n+p 

| > mitai<e (1.9) 

hzoen+if 
for all n > N (e), all natural p and all x of {2}. 

Theorem 4.2 is a consequence of Theorem 1.4: it is sufficient to 
notice that under the modulus sign on the left of (4.9) we have the 
difference S, +4) (x) — S, (x) of the partial sums of (4.8). 

Proof of Theorem 1.1. (1) Necessity. Let {f, (x)} converge uniformly 
on {z} to some limit function f (x). Choose an arbitrary ¢ > 0. For 
the positive number e/2 we can find N such that for all n> WN and 
for all x of {z} 


| fn (2) — f (2) | < e/2. (1.10) 


If p is any natural number, then for rn > N andifor all x of {x} 
all the more so 


| fnep (2) — f (2) |< 2/2 (4.44) 


Since the modulus of a sum is not greater than the sum of moduli, by 
(1.10) and (4.14) wo get 

| fntp (t)— fn (@) 1 =| Une (2) —F (2) +7 (2) — Pn IIS 

<I fa+p (e)— F(z) [+1 fF (2)—fn (2 <e 
for all x >WN, aj) natural p and all z of {z}). Necessity is proved. 

(2) Sufficiency. Inequality (1.7), together with the Cauchy criterion 
for the number sequence, implies the convergence of {f, (x)} for any 
given « of {z} and the existence of a limit function f (z). 

Since (1.7) holds for any natural p, by proceeding in this inequality 
to the limit as p — oo (sce Theorem 3.43 in [4}) we find that, for all 
n>WN and for all x of {zx} 


1 f(z) — fr @) I<e. 
By the arbitrariness of « > 0, sufficiency is proved. 
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1.1.5. Sufficient tests for uniform convergence. Depending on 
convenience we shall formulate the tests for uniform convergence 
either in terms of sequences or in terms of serics*. 

We introduce a new concept to formulate the first test. 

Definition. A sequence of functions {f, (z)} is said to he uniformly 
bounded on a set {7}, if there is a real number \ such that for all x of 
{r} and for all u we have | fp) |< A- 

Theorem £.8 (Abel-Dirichlet test). Let 


x 


NY ney (x) 0, (L) 


=! 
bea junctional series. It converges uniformly ona set {z}, if the following 
two conditions hold: 
(i) the sequence {v, (x)} is noninereasing on {x} and uniformly 
converges on {x} to sero; 
xv 


oe , ° - 
(ii) the sertes “uy (r) has a sequence of partial sums uniformly 


bounded on {r}. 

The proof coincides almost textually with that of the corresponding 
test for the canvergence of number series (see Section 13.5.2 in {1}). 
The render should carry it out on his own. 

Example 1. As an illustration, we discuss uniform convergence 
of the series 


+ sinks 
oe (1.12) 
het 
Since {{/k} (for all x) is not increasing and tends uniformly to zero, 
by the \bel-Diriehlet test, (4.12) converges uniformly on any set on 
which 
a 
. - 3 
SM sin dr (1.12 
Rt 
has a uniformly bounded sequence of partial sums. We compute and 
evalnate the nth partial sum S, (x) of (1.45). 
Summing the identity 
Fs , \ 
asin =-sin kr = cox (7: _ 5) r—COs (i ste $j r 


” » y 


~ “ ~ 


over all & from { to n, we get 


x 4 
2sin=-S, (z) == COS s — COS (n te =)s. 


a 
~ 
Emenee 


* By what was said in Section 1.1.41 both formulations an: equivalent. 
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From this 
x 4 
cos ~—cos{n+t—ji 2 
2 
Sn (a) ee 
2sin 3 
Therefore for all n 
[Sn (2) [<4 (1.44) 
| sin z 





From inequality (1.14) it is evident that the sequence {S, (x)} 
of partial sums of (41.13) is uniformly bounded on any fixed in- 
terval containing no points z,=21m(m=0, +1, +2,...), for 


. . =z ears ° 
on any such interval | sin x | has a positive infimum. 


Thus we have proved that (1.12) converges uniformly on any inter- 
val containing no points z, = 2nm, where m = 0, +4, +2,.... 
Theorem 1.4. (Weierstrass test). If a functional series 


N 

R=A 
is defined on a set {x} and if there is a convergent number series’ 
co 


Up, (x) ; (1.45) 


Soc, such that for all x of a set {x} and any integer k 


[ty (t)| Sen, (4.16) 


then (4.45) converges uniformly on {z}. 

Concise statement: a functional series converges uniformly on a 
given set if it can be majorized on that setby a convergent number 
series. = 

Proof. By the Cauchy criterion for the number series BY Ch, 

k=A 
for any e>0O there is N(e) such that for all n>N(e) and for 
any natural p 


ntp 


pry HSE (1.47) 
s 


From (4.16) and (4.17) and from the fact that the modulus of 
a sum is not greater than the sum of moduli we get 


n+p 


» Up (2) 
h=nt+i 


=n+ 


<e 








(for all nN (e), all natural p and all x of {z}). 
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i] 
te 


By the Cauchy criterion, (1.15) converges ‘uniformly on {z}, 
Thus the theorem is proved. 
Example 2. The scries 





~ 
+ sinks ener 
By oe where 6>0, 


het 
converges uniformly on the whole of an infinilo straight line, for on 
the entire straight line 

i sinks 

| Bird 


2 
- 
= pins ’ 





ow 
~ xr , 
and the number series >! 7775, with 6 > 0, converges (see Chap- 
Ker 


ter 13 in [4]). 

Remark 1. The IWeierstrass test is not necessary. 

Indeed, it was established above that (1.12) converges uniformly 
on any interval containing no points a, = 23m by =D), 4-4, 3: 2,... 
...). In particular, (1.12) converges uniformly on [1/2, 37/2]. On 
this interval, however, the absolute yalue of the kth term of (1.12), 

foe) 
, has a supremum equal to 1//, i.e. the majorant »y + is 
hel 


jain iz] 
k 


known to be a divergent harmonic scries. 

Theorem 1.5 (Dini test*). Let {fy (z)} be a sequence not decreasing 
(or not increasing) at each point of a close interval {a, b) and converging 
on that interval to a timit function { (x). Then, tf all the elements of the 
sequence f, (x) and the limit function f (x) are continuous on [a, b], the 
convergence of {f,, (z)} is uniform on {a, 6). 

Proof. For definiteness suppose that {f, (z)} is not decreasing on 
[a, b] (the case of nonincreasing sequence can bo reducod to this case 
by multiplying all the clements of the sequence by —14). 

Put 


r, (zt) = f(t) — fn (). 


The sequence {r, (z)} has the following properties: 

(1) all r, (x) are nonnegative and continnous on [a, b); 

(2) {r, (z)} is nonincreasing on [a, &); 

(3) at each point z of [a, b] there is a limit lim r, (z) = 0. 


Nooo 

We want to prove that {r, (x)} converges to zero uniformly on 

(a, 6]. It suffices to prove that given any © > O, there is af least onen 

such that r, (zt) < at once for all x of {a, 0) (then by property (2) 
above r, (z) <e for all subsequent integers too). 





* Ulisse Dini (1875-1048) fs an Italian mathematician. 
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Suppose given some e > O wecan find no msuch thatr, (x) << at 
once for all x in {a, b]. Then for any nm there is a point z, in {a, }} 
such that 


Tn (Tp) S &. (1.18) 


By the Bolzano-Weierstrass theorem, we may choose a subsequence 
{xp,} of {,} converging to some point zy in [a, b] (see Section 3.4 
in {1]). 

All r,, (x) (given any m) are continuous at x9. Therefore for any m 


Pe Tm (Ln,) = Tm (Xp). (1.19) 


On the other hand, on choosing for any given m some np, greater than 
m we obtain (by property (2) above) 


Tm (2n,) =n, (Zn,)- 
Comparing the last inequality with (1.18) we have 
Tm (Zn, ) SE (1.20) 


for any given m and any my, greater than m). Finally, comparing 

(1.49) and (4.20) yields : 
Tm (po) > & 

(for any m). 

The last inequality contradicts the convergence of {r, (x)} to zero 
at Zp). This contradiction proves the theorem. 

Remark 2. Essential in the Dini theorem is the condition of mono- 
tonicity of {f, (z)} on [a, b], for a sequence nonmonotonic on [a, b} 
of functions continuous on [a, b] may converge at each point of [a, b] 
to a function f (x) continuous on [a, b], but without converging to 
it uniformly on [a, 5]. 

A sequence of functions f, (x) equal to sin nz for O<2<in/n 
and to zero forn/n <Cz<n(n = 1, 2,...) may serve as an exam- 
ple. It converges to f (x) = 0 at each point of [0, x] but is not uni- 
formly convergent on [0, x], for | fn (fn) —f (tn) | = 1, given 
Z, = n/2n for all n. 

Remark 3. We formulate the Dini theorem in terms of series: 
if all terms of a series are continuous and nonnegative on a closed interval 
{a, b] and the sum of the series is also continuous on [a, b], then that 
series uniformly converges to its sum on [a, b). 

Remark 4. The Dini theorem and its proof remain valid if we take any bound- 


ed closed set {x} instead of [a, 4) in the theorem. It is customary to call such a 
set a compact sect. 


Example 3. The sequence {x"} uniformly converges to zero on 
a closed interval [0, oy 


te 
=f 
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Indeed, (1) for any z in [ 0. =| the sequence converges to 7era; 
(2) all the functions x" and the limit function zero are contin- 
uGus on [ 0. z|3 (3) {z"} is not increasing on [o. ae 

Thus all the hypotheses of the Dini theorem are satisfied. 

1.1.6. Proceeding to the limit term by term. Continuity of the sum 
of a series and of the Jimit function of a sequence. Consider a point @ 
on an infinite straight line. Let {z} be a set that may not contain @ 
but such that there are points of the set {x} in any e-neighbourhood 
of a’. 

The following statement holds. 

Theorem 1.6. Let a functional series 


low 


N uy (2) (1.15) 
! 


converge uniformly on a set {x} toa sum S (x). Further let ali terms of 
that series have ata point aa limiting value 


tim uy, (z) = b). 
een 
Then the function S {x} also has a limiting value at a, with 
lim S(z)= “ lima, (r= \ by, (1.21) 
Aon R= fr--a fd 
i.e. the limit sign lim and the summation sign “’ may be interchanged 
(or, as we say, we can proceed to the limit (erm by term). 
Proof. We first prove that the number series “ b, converges. 
k=1 
By the Cauchy criterion applied to (1.15), given any & > 0, we can 
find N (e) such that 
pen (2) + tinge (2) bee. tnay GE <e (1.22) 
for all n > WN (e), all natural p and all z of {x}. 
Proceeding in (1.22) to the limit 2 —--a** we get 
| byway HS) Daeg a ig by +p jae< 2 
(for al] 2 SN (e) and all natural p). 


The Cauchy criterion holds for \’ b, therefore. and the series 
reas 
converges. 





“tn other words, ars the limit point of {7}. 
#8 Fe do thir we can use same sequence of points {7,,) converging to a. 
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~ 


Now we evaluate the difference § (2) — \ , for all values of z in: 
k=l 


we 
a snall neighbourhood of a. Since § (x)= \ uy (x) for all points of 
R= 


{x}, given any n we have 
~ n n z 
S()— LS R=IN a @—L ale So ou @— Nb. 
k=] k=! hel kent k 
From this we obtain for all x of {x} 


© n n ~ 
[S(jJ— N&l<|Nu@—S aft] Sou w+ 
ket k=l k=l kant+l 


\ a J 949 
+| 2: Op I. (1.25): 
=n+1 


~w 
Take e > 0. Since the series S’ b, converges and since (4.15): 


k=t 
converges uniformly on {zx}, for given € we can find » such that. for 
all x of {zx} 


aw 


E & cy 
| S &l<$. | D m@|<z. (1.24) 
A=nt+! tieen+i 


Since the limit of a finite sum is equal to the sum of the limits of 
summands, for given € > 0 and the chosen r there is § > 0 such 
that 


| > up (2)— Db, \<+ (1.25) 
hot 


h=t 


for all x of {x} satisfying the condition 0 << |2a—a|<4. 
Putting (4.24) and (1.25) in the right-hand sido of (1.23) we finally 
get 


| S(a)— Md, |<e 
kel 


for all the points z of {z} satisfying the condition 0 << |z—a|{<4. 
This proves that the function S (z) has a limiting value at z = a 
and that equation (4.24) holds, Thus the theorem is proved. 
Now we formulate Theorem 4.6 in terms of functional sequences. 
If a functional sequence {f, (x)} converges uniformly to a limit 
function f (x) on a set {x} and if each element of the sequence has a 
limiting value at a point a, then f (x) also has a limiting value at a, 
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ap tht 


fim f(r) lim (lim f, (x)) = lim im f (xr)), 


veg nee Nw Yn 


1.¢, the sign of the limit of a sequence lim and the sign of the limiting 


Tl-=3 0 
unluc of a function lim may be interchanged (or as we sau we can 
Veen 
proceed to the limit as x >a element by element). 

Remark to Theorem 1.6. If under the hypotheses of Theorem 1.6 
we in addition require that a should belong to {zx} and that all terms 
u, (x) of (1.15) should be continuous at a (or respectively continuous 
wf aon the right or the left), then the sum S (x) of (1.15) is also 
continuous at a (or respectively continuous at a on the right or the 
Jeff). 

Indeed, in this case b, = u, (a2) and equation (1.21) becomes 


om 
lim S(z)= “’ uw, (a) = S (a), 
.? hes} 
which just implies the conlinuity of the function S (z) at a (or, if x 
tends to a from one side, the continuity of S (x) at @ respectively on 
the right or on the left). 

Applying the above remark to cach point of some closed interval 
la, 6] we arrive at the following main theorem. 

Theorem 1.7. 1f all terms of a functional series (all elements of a 
fitnctional sequence) are continuous on a closed interval fa, b} and if 
that series (that sequence) uniformly converges on [a, b], then the sum 
oe series (the limit function of the sequence) is also continuous on 
a, 9). 

Remarks to Theorem 1.7. (1) In Theorem 1.7, instead of a closed 
interval [a, 6] we may take an open interval, a half-open interval, 
a half-line. an infinite straight line or any set {x} dense in itself in 
goneral. (2) Essential in Theorem 1.7 is"the requirement on uniform 
convergence, for a nonuniformly convergent sequence of continuous 
functions may converge fo a discontinuous function (see Example (1.3) 
in Sections 1.1.4 and 1.4.2). 

Coneluding remark. Al! the theurems of this section are true for 
sequences of functions given on a set fr) of £". 


1.2. TERM-BY-TERM INTEGRATION AND TERM-BY-TERM 
DIFFERENTIATION OF FUNCTIONAL SEQUENCES 
AND SERIES 


§.2.4. Term-by-term integration. The following main theorem holds. 
Theorem 1.8. Sfa functional sequence {f, (7)} uniformly converges 
tna limit function j (x) on a closed interval {a, b\ and if every function 
f, tc) is integrable on fa, b], then { (z) is also integrable on {a, 0), it 
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being possible to integrate {f, (x)} over {a, b] element by element, i-e. 
b 
lim j fn (x) dz 


N-00 
fa 


6 
exists and is equal to J f (x) da. 


Proof. Choose ¢ >. Then, by the uniform convergence of {f, (z)} 
to f (x), there is N (€) for e > 0 such that for all n > N (e) and for 
all x in [a, b] 


| fn (x) —f (x) | er Tore (1.26) 
If we prove that f (x) is integrable on [a, b], then, using the ordinary 
evaluations of integralst and inequality (1.26), we get 

b b b 


| \ fn (x) dx — j f(z) da| =| j (fn (x) —f (x)] ax|< 


a 


o 


) 
<Jlt(—f (2) |\ae<agte | dem t<e 


a 


(for all n> N (e)). 
b 


This proves that the limit lim \ fn (x) dz exists and is equal to 
N—-oco 
a 


f (x) dz, and it remains for us to prove that f (x) is integrable on 


a Reeesge 


{a, 5). 

On dividing [a, b] by means of arbitrary pointsa = zy9<2,<... 
-..<2m = b into m closed intervals [z,_,, x,] (k = 41,2,...,m 
we agree to denotejby w,, (f) (respectively by w, (f,)) oscillation on 
the kth closed interval [x;,_,, z,] of f () (respectively of f, (z))** 


* We mean the following evaluations of integrals established in Section 10.6 
of [4]: (1) if a function F(z) is integrable on [a, b], so is | F (x) | with 


|| F@as 





< |? (2) | de (2) if f(z) and g(z) are both integrable on 
a 
b 


b 
[a, b}] and everywhere on it f(z) < g (x), then {(@dr< ( g (x) dz. 


a a 
** Recall that the oscillation of a function on a given closed interval is the 
duniereare between the supremum and infimum of the function on the given 
interval. 
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We want to see that given any © > O and any k = 1,2,.... 2m, 
we can find a sufficiently large n for which 


on (No, (hi d- a (1.27) 


b—a ~ 
Indeed, whatever x’ and x” of [,-), 2], we have 
Lp(a’ }— f(r" I<] f(z’ y— fn (2’ ) ff fe (2! )—/, (2") fae 
| falr’)—F{r’)j. (1.28) 


By the uniform convergence of {f, (7)} to f (zx), given any e > 0, 
there is xn such that for any x in [a, b] inequality (1.26) holds. Thus 
for this n 


HP —fal@ + fa PV <Sae 
and therefore, by (1.28), 


Fi 


LFV In (2) inl2) 1 + Ge 


From the Jast inequality and from the arbitrariness of points a’ 
and #7” it immediately follows that inequality (1.27) holds for the 
chosen integer n. 

Denote now, for the arbitrary subdivision of fa, b] we have assumed, 
the upper and lower sums of f (r) by S and s and the upper and Jower 
sums of f, (r) by S,, and s,. 

Multiplying inequality (4.27) by the length of the Ath closed in- 
terval Ax, and then summing it over all *& = 41, 2, ..., m we get 


S—s<S, —s, 4-€. (1.29) 


Inequality (1.29) is established by us for an arbitrary subdivision 
of fa, UJ. By the integrability of the function f, (7) on fa, b] we can 
find a subdivision of [a, b] for which S, — s, <(e* and therefore, 
by (4.29), § —s< 2c. 

Since ¢ ig an arbitrary positive number, the last inequality proves 
that f (7) is integrable on [a, b]**. Thus the theorem is proved. 

Now we formulate Theorem 1.8 in terms of functional series: 

Ifo functional series (A15) converges to its sum S (x) uniformly on 
a closed interval {a, b] and i if cach term of thal series uj, (x) isa function 
integrable on [a, b], then S (x) is also integrable on a, b), it heing 


* Ry Theorem {4-4 of (tf. 

** By Theorem (tof (tf, the existence for an arbitrary ¢ >- of a sth. 
division of a closed interval for which S — s-< 2r isa necessary and suf ient 
condition for any function founded on the interval to be integrable. The hounded- 
ness of ffx) on fa, 4) iminediate ly follows from (1.26) and from (he boundedness 
of (he function /,, (2) integrable on fa, b]. 
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possible to integrate (1.15) over [a, b] term by term, i.e. the series 


co ob 


>» f ua (x) dz 


k=la 


b 
converges and has as its sum j S (x) dz. 


a 

Remark. In courses of mathematical analysis Theorem 1.8 tends 
to be proved under the more stringent assumption that every function 
fn (x) is not only integrable but is continuous on [a, b] as well. With 
this additional assumption the above proof becomes simpler, for it 
is sufficient to refer to Theorem 1.7 to prove that the limit function 
f (x) is integrable on [a, b}. 

1.2.2. Term-by-term differentiation. Now we prove the following 
main theorem. 

Theorem 1.9. Let every function f, (z) have a derivative f, (z) on a 
closed interval la, b]*, the sequence of derivatives {f, (x)} converging 
uniformly on {a, b] and the sequence {f, (x)} itself converging at least 
at one point x» of la, b]. Then {f, (x)} uniformly converges to some 
limit function f (x) on the entire interval [a, b], {f, (z)} being differenti- 
able on {a, b] element by element, i.e. everywhere on [a, 0] f (x) has 
the derivative f' (x), which is the limit function of {f;} (x)}. 

Proof. We first prove that {f, (x)} uniformly converges on [a, B]. 
From the convergence of the number sequence {f, (z)} and from 
the uniform convergence on [a, b] of {f;, (x)} we deduce that given an 
arbitrary &¢ >> 0 we can find WN (e) such that 


| fntp (Zp) —fn (Xp) | <3, | fnep (2) ~—fn (x) | <z Too (1.30) 


for all n > N (e), all natural p and (this applies to the second of the 
inequalities (4.30)) all 2 of [a, b]. 

Let x be an arbitrary point in [a, bJ. Given any fixed n and p, 
all the hypotheses of the Lagrange theorem hold on [zy, 2] for the 
function [fn4p (t) — fa (4)] (see Theorem 8.12 in [1]). By that theorem 
there is a point — between x and 2, such that 


[fn+p (2) —fn (2)] — [ftp (20) — fn (Z0)] = 

= [fntp (6) — fn (€)] (—2)- 
From this last equation and from (1.30), on taking into account the 
fact that | 2 — 2) |< b—a, we get 

| fntp (2) — fr (t) |<e 
(for any x in [a, b], any n > N (e) and any natural p). 

* Here and in what follows by “f (z) has a derivative on a closed interval 


{a, b]” we mean the existence of a derivative f’ (xz) at any interior point of [a, 5J, 
the right-hand derivative f’ {a + 0) at a and the left-hand derivative f’ (6 — 0) 
at b. 
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Put this just means thet {/, (z)} converges uniformly on Ia, dU} 
!o some limit function f (z)*. 

It remains to prove that f(z) has e@ derivative at any point x, in 
fa. 6) ane that that derivative ic the limit function oj {f, (z)}. 

Choose an arbitrary point z_ and, correspondingly, a positive 
number 6 such that the é-nefghbourhood of z, is contained entircly 
in fa, b] (in case z, is an end point of fa, b], by the 6-neighbourhood 
of z, we shal) mean either the right-hand half-neighbourhood 
la, a +- 5) of the point a or respectively the left-hand half-neigh- 
hourhood (L — 6, bj of 8). 

Denote by {Az} a set of all numbers Ax satisfying the condition 
O<}Ar|<& whena <7, <b, the condition 0 << Az < 6 when 
Zp == 1 or the condition —6 < Az <0 when zo = 6 and prove that 
the sequence of functions of the argument Az 


Ja (Zo-, Az)—fr. (=) 


Gr (Az) aa Az 


converges uniformly on the set {Az}. 

Given an arbitrary ¢ > 0, by the uniform convergence of {f;! (z)} 
there is NV (e) such Chat 

litap(2i—flzyi<e (1.34) 
for all z in fa, b], all xn S N (e) and al} natural p. 

Observing this, choose an arbitrary Az of the set {Az} and apply 
the Lagrange theorem to [f,+, (t) — f, (t)] (with any n and p chosen) 
on [35, to + Az). By the theorem, there is a number 8 inO <0 < 4 
such that 

Gop (AZ)— 4, (Az) = 

= [inap (ro-t Az)—In (t9-+ Oz) —[fy an (=e) —In (Fo) 

at Ar 

= fisn (ta OAT) — f5 (79+ 0 Az). 

From the last equation and from inequality (1.34) valid for all 
the points 7 of [a, b] we get 

1Grn-+p (Az) — Py (Az) J <E 
for any Az of {Az}, any n> N (ce) and any natural p. Thus 
{q, (Az)} converges uniformly on {Az} (by the Cauchy criterion). 


But this allows Theorem 1.6 on proceeding to the limit term by term 
to he applied to {¢, (Az)} at Az = 0. According to Theorem 1.6%*, 


{ (%o -- Az) — 1 (20) 
ar + 


* By the Cauchy criterion, i.e. by (Theorem 1.4. 
¢* The formulation of Theorem 4.6 in terms of functional equences is useds 


Ch. I. Functional Seguences and Functional Series 31 


the limit function {p, (Az)}, has a limiting value as Az — 0, with 


L(eo> AD) 1) _ Jim [lim @, (Az)] = 
Ar Ax-0 n-+09 


=lim [lim q, (Az))] = lim [ lim 2 Got SIs Co) | le 
Nos Ax~0 noc /Ax—0 z 


_ lim fn (Zo) 


This proves that the derivative of f (x) at Z, exists and is equal to: 
lim fn (9). The theorem is proved. 


N+ co 
Now we formulate Theorem 1.9 in terms of functional series. 
Ij every function w),(a) has a derivative on a closed interval 
ow 


(a, b} and if the series of derivatives \‘ u}(x) converges uniformly 
k=1i 


on fa, b] and the series S‘ y, (x) itself converges at least at one 
n= 


ce 


point of the interval fa, b}, then SY ag (x) converges uniformly on 
K=4 


the entire interval |[a, b] to @ certain sum S (x), this series | being 
differentiable on ja, b} term by term, i.e. its sum S(x) has on 
co 


{a, b] a derivative which is the sum of the series of derivatives > uj (zx). 
R12 


Remark 4. We stress that Theorem 1.9 assumes only that every 
function f, (z) has a derivative on [a, b]. Neither thetboundedness nor, 
moreover, the integrability or continuity of that derivative is 
required. It is usual in courses of mathematical analysis to prove 
Theorem 1.9 under the additional hypothesis that every derivative 
fn (xz) on {a, 5] is continuous. 

Remark 2. If Theorem 1.9 requires in addition that every derivative 
4m (tz) should be continuous on [a, b)], then by Theorem 1.7 the deriv- 
ative of the limit function f(r) is also continuous on {c, 9d}. 

Remark 3. For the case of functions of m variables Theorem 
1.9 assumes the following form: if every function f, (z)=fp > 
X (2, .... 2m) has on a bounded set {z} of points in E™ a partial 


derivative we and if the sequence {5} converges uniformly 
on {x} and the sequence {f, (z)} itself converges at each point of 
{x}, then {f,(z)} can be differentiated with respect to a variable 
xz, on {x} element by element. 

Theorem 1.9 yields the following statement. 

Theorem 1.10. If every function f, (x) has an antiderivative on a, b} 
and if the sequence {f, (z)} converges uniformly on [a, b] to a limit 
function f (x), then f (x) also has an antiderivative on {a, b}. oreover, 
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ii ry is anu point of la, b), then the sequence of antiderivatives D,, (2) 
of the functions f,, (x) satisfuing the condition , (x9) = 0 converges 
uniformly on la, b) to the antiderivative (x) of f (x) satisfying the 
condition  (r,) = 0). 

Proof. It suffices to notice that for the sequence of antiderivatives 
,, (x) satisfying the condition @, (75) = 0 all the hypatheses of 
Theorem 1.9 hold. This ensures that the sequence {@, (z)} converges 
uniformly on (a, 6] to the limit function @ (7) which at cach point of 
la, b] has a derivative equal to the limit function f (r) of {f, (x)}. 

Remark 4, We stress that Theorem 4.10 requires neithert he bound- 
edness nor, morcover, the integrability of functions 7, (r) on [a, bd]. 

The last three subsections allow us to draw the following important 
conclusion: uniform convergence does not change the class of functions 
having a limiting value (Theorem 1.6), the class of continuous functians 
(Theorem 1.7), the class of integrable functions (Theorem 1.8), the class 
of functions having an antiderivative (Theorem 1.410) or the elass 
(in the case of uniform convergence of derivatives) of @ifferentiable 
functions (Theorem 1.9). 


In conclusion consider an example, based on Theorem 1.9, of a function f (x) 
where derivative js’ (z) exists everywhere on a closed interval [0, 1] but is dis- 
continuous at each rational point of the interval, 

Let 


5] 
cos — when + 3: Oy 


0 when z=0, 


so that the function 


: { chlt coos whens = a, 
qi (zy | z 
t UY when [zr -=( 


is discontinuons at x = O antl continuous at all the other points. We number all 
the rational points of [G, 4] to form the sequence 74, ray oe ee Tye eee (the 


possibility of this was proved in Section 3.4.3 of [1}) and put ua, (x) = att “ 


“ Pee 1 ws s 
> (r ~ 2). Thon every derivative uj (z) == TF q’ (x — z,)_is discontinuous 


at ane paint z, and continuous at all the ather points. Since for all z of {0, 1) 


r— ry, fF i a 
ii epee a et feet 


ke ‘ he 


oan 
Sopeg 7 

oO Es 9) 

. .’ . so 

both serics “Yo uy (xr) and uj (r), are majorized by the convergent number 

Fee Wl 

iso] 
: { Z ; 
series 3 ys Tee and therefore converge uniformly on [U, 1}. By Theorem £,9 
.7 


Lo 
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ao 


the sum f (z) of 5’ u, (2) has on (0, 4] a derivative f’ (z) equal to the sum of 


>! uf () and discontinuous at every point z, (k = 1, 2,...). 
k=1 

1.2.3. Convergence in the mean. Suppose every function f, (x) 
(n = 1, 2, ...) and the function f (z) are integrable on a closed 
interval [a, b]. Then (as is known from Chapter 10 of [1]) so is the 
function 


(fn (2) —f (2)? = fa (2) +P (2) —2 fn (2)-F (2)- 


We introduce the fundamental concept of convergence in the mean. 
Definition 1. A sequence {f, (z)} is said to converge in the mean toa 
function f (x) on a closed interval [a, bj, if 


b 
lim | Un (@)—# ()PR dz =0. 


Definition 2. A functional series is said to converge in the mean to 
a function S (x) on a closed interval [a, b] if the sequence of partial sums 
of that series converges in the mean to S (x) on fa, b). 

Remark. It follows from the definitions that if a sequence (or a 
series) converges in the mean to f (z) on the entire interval [a, b], 
that sequence (or that series) converges in the mean to f (x) also on 
any closed interval [c, d] contained in [a, }] 

Now we wish to show the relation between convergence in the 
mean and uniform convergence of a sequence. 

We first prove that if a sequence {f, (x)} converges uniformly to 


f (z) on {a, BJ, then {f, (x)} converges also in the mean to f (x) on {a, 5]. 
Take an arbitrary e > 0. Given a positive number V by 


uniform convergence there is N such that 


[O-KON<V apy (1.82) 


for all z in fa, b] and alln>WN. 
By (1.32), for all n>WN 


& 
2(b—a)’ 


b b 
ee eee 


i.e. {7, (x)} converges in the mean to f(z) on [a, B}. 

Now we shall show that convergence of a sequence on some closed 
interval in the mean does not imply not only uniform convergence 
that interval but also cone >ce at least at one point of the ° 


nt 
as 


Furdementale of Mathematical Anclysis 


Consider a sequence of closed intervals J, J,, ... belonging to 
10, 4] and having the following form: 


Ty (0, ay, 


4 1 
n=[0G], b=[7- 3], 
10639 3 
b=[37] h=[F *], 


eo 8 © © © © © eo oe eo © we we ew ew ew 


n 


4 4 2 
In =[0, 2m J? Firat = [ae “x |; a 


ee © © © Be © ew ew o 8 6 


We define the nth element of the sequence as follows 

eee a 4 on J, 

a { O at the other points of [0, 4]. 

The sequence we have constructed converges in the mean to f (x) = 0 


on [0, 4]. 
Indeed, 
1 
{fn (2)—OPdz= | f(a) de= | dr= 
) i in 


==length of closed interval J, —- 0 (as n —» oo). 


At the same time the sequence converges at no point of {0, 4). 

Indeed, whatever point zy of [0, 1] we may take, among arbitrarily 
large n we can find both such for which J, contajns a point z, (for these 
integers f, (%)) = 4) and such for which J, does not contain zp (for 
these integers 7, (ro) = 0). Thus {f, (79)} contains infinitely many 
elements, both equal to unity and zero, i.c. this sequence diverges. 

It turns out that convergence of {f, (z)} to a limit function f (z) 
on [a, b} in the mean ensures that {7, (z)} can be integrated over 
{a, ] clement by element. 

Theorem 1.41. If a sequence {f, (z)} converges in the mean to a 
function f (z) on a closed interval (a, b}, then that sequence can be in- 
tegrated over fa, b] element by clement, i.e. 

b 
lim | f,(2) dz 


Nom © 
c 


{ (2) de. 


exists and is equal to 


Rey 
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We first prove the following lemma. 
Lemma 1. For any functions f (x) and g(x) integrable on’a closed 
interval [a, b} we have the abana 


i f(z) & (2) dz|< ys} ae ae &2(z) dz (1.33) 


called the Cauchy-Buniakowski fneniality. 
Proof of Lemma 1. Consider the following quadratic trinomial in .: 


b 
| if @)—2e @)Pdz= 


6 b b 
= | #2 (@) da—2a [ f(x) eg (x) de |e? (2) dedo. 


Since this trinomial is nonnegative, it has no distinct real roots. But 
then its discriminant is nonpositive, i.e. 


( f (2) & (z) dz) — jig (z) dz ( g? (z) dr<0. 


Thus the lemma is proved. 
Proof of Theorem 1.11. Using inequality (1.33) for g (x) =1 
we have 


b b b 
{{ fn (x) dz — f f(z) dx |= [\t { iF fn (2) —f (2)] atl< 
< j (fn (x) —f (2) J? dx dx = 


=V 6—«) | Un (2)—f(@)P de + 0 
(as m—» 00). The theorem is proved. 


1.3. EQUICONTINUITY OF A SEQUENCE OF FUNCTIONS. 
THE ARZELA THEOREM 


Suppose each of the functions 7, (x) is defined on some closed 
interval {a, d]. 

Definition, A sequence of functions {fn (z)} is said to he equicon- 
tinuous on [a, b] if given any & > 0 we can find 6 > 0 such’ that 

I in (2) —fr (2) | <e : 
3r 


a 
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holds for all n and for all points x' and x" of {a, b) related by 
jx’ — 2" [<. 


Remark 41. It is immediate from the definition that if {f, (z)} is 
equicontinuous on [a, b}, then so is any of its subsequences. 

We prove the following remarkable statement. 

Theorem 1.12 (Arzela). If a sequence of functions {f, (z)} is equicon- 
tinuous and uniformly bounded on a closed interval [a, b}, then we 
can choose a subsequence uniformly converging on [a, b). 

Proof. Consider on [a, b} the following sequence of points {z,}: 
take as z, the point bisecting [a, bJ, as z, and zy the two points quar- 


Fig. 4.3 


tering, togother with z,, the interval [a, b] (Fig. 1.3), as 2,, 25, 75, and 
z; the four points dividing, together with z,, 7, and zg, tho interval 
[a, b] into eight equal parts (Fig. 1.3) and so on. 

The sequence {z,} we have constructed has the following property: 
whatever & > Owe take, we can find for it zp) such that on any interval 
of [a, b) of longth & there is at least one of the elemonts 2, 22, .. + 
ae ks 

Now wo proceed to choose a subsequence of {f, (z)} uniformly 
converging on [a, b]. First consider {f, (z)} at z,. We obtain a bounded 
number sequonce {f, (z,)}; by the Bolzano-Weierstrass theorem (seo 
Section 3.4 of [1]) we can choose a convergent (or regular) subsequenco 
of {f, (z,)} which we designate 


haa (@)s fae (Gada - - or fan (Sr ee 
Thon consider the sequence 


fra (z)s fae (Zr ee oe Sin Ce 


at z.. By the Bolzano-Weierstrass theorem we can choose a con- 
vergent subsequence which we designate 


fay (%2)e fae (Zar or Fen (Ze), 2 ee 
Thus the sequence 
fos (2)s foo (2) «+ +s fan (Zs -- (1.34) 


is convergent at both z, and z,. 
Next consider (1.34) at z,; and chooso a convergent subsoquence 


1s: (2s)1 fe (Zs)1 - + or Fan (2a), 0 0 


* A sequence baving this property is said to be everywhere dense on [a, 6). 
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Continuing our arguments in a similar manner we obtain an infinite 
number of subsequences 


fit (2)> Fro (@)> Fas (2), ++ 0s Fan (2), oo 
for(%)> for (2), fos (&), «+01 fon (Z). +++ 
fas (2). faz (2), fas (2), -- 1 fan (Z), >> 


Oe 


tna (2)1 Fro (@), fra), ++ +> Fan {2 +6. 


Ce i 2 


’ the sunen tenes in the nth row being convergent at each of the points 
Ty, Lo, + +s 
Now consiler ‘what is called a “diagonal” sequence 


fis (2)s foo (@). ~~ +s fan (@)) ~~ 


We shall prove that this sequence uniformly converges on [a, J. 
To abbreviate the notation in what follows we shall designate this 
(as well as the original) sequence as 


TD rte De etd Ow ee 


(i.e. we shall use a single index instead of the double one). Take an 
arbitrary s > 0. 

Since the diagonal sequence is equicontinuous on fa, 5], given 
& > 0, there is 5 > 0 such that whatever two points x and z,, of 
{a, b] related by |z — 2m | <6 we may take, for all n 


| fn (2)—fn (2m) | <ee (1.35) 


Noticing this fact we divide [a, b] into a finite number of closed in- 
tervals of length smaller than 6. We choose a finite number ny of the 
first elements 21, 22, -.., Xn, Of {x,} large enough for eack of the closed 
intervals to contain at least one of the points z,, Xo, . . «) Xn, 

Obviously the diagonal sequence converges at each of the points 
X44, Za, .. +, Ln, Given the above & > 0 therefore, we can find N 
such that 


| fntp(tm)— Fn (Tm) |< = (1.36) 


for all nm > N, all natural p and all m = 1, 2, 

Now let x be an arbitrary point on [a, b]. It would ie. in one of the 
above closed intervals of length smaller than 5. For this x therefore 
there is at least one point z,, (m is one of the integers equal to 
4, 2, ..., mp) satisfying the condition |z— 2, |< 6. 
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Since the modulus of the sum of three terms is not. greater than the 
sum of theirtmoduli, we can write 


| frep (x) —f,, (x) I<| fntp (z)— ftp (Zy1) | + 
+-] Jaap (tn) —fa (2m) f+ fn (tm) — fs (z) |. (1.37) 


We evaluate the second term on the right-hand side of (4.37) 
by means of inequality (1.36) and to evaluate the first and the third 
term we use the fact that |z—z, |<(6 and inequality (4.35) 
holding for any n (and therefore for any x + p). 

We finally have that given an arbitrary e > 0 there is N such that 


lfitp (2) — fn (2) l<e 
for all 2 >> N, all natural p and any point z in [@, b]. Uniform con- 
ee of the diagonal sequence is proved. Thus Theorem 1.12 is 
proved. 

Remark 2. In the Arzela theorem, instead of uniform convergence of 
{fn (z)} on fa, b) it is sufficient to require boundedness at least at one 
point of the interval. Indeed, tho following statement is true: if a 
sequence {f, (x)} is equicontinuous on a closed interval [a, b] and bounded 
at least at one point xp of the interval, then it is uniformly bounded on 
[a, Lb}. To prove this we notice that by the definition of equicontin- 
uity, given ¢ = 4 we can find 6 > O such that the osefllation of any 
function f, (z) on any closed interval not greater than 6 does not 
exceed ¢ = 1. Since the entire interval [a, 0] can be covered with a 
finite number ny of closed intervals of Jength not greater than 6, 
the oscillation of any function 7, (x) on the entire interval [a, b] does 
not exceed the number ny. But then the inequality {fp (to) {<A 
expressing the boundedness of {f, (z)} at z) implies the inequality 
If/n (z) | <A + ny true for any point z of [a, b] and expressing the 
uniform boundedness of the sequence under consideration on [a, b]. 

Remark 3. We establish a sufficient test for equicontinuity: if 
a sequence {f, (x)} consists of functions differentiable on a closed interval 
[a, b] and if the sequence of derivatives {f;, (x)} is uniformly bounded on 
that interval, then {f, (x)} is equicontinuous on [a, b). 

To prove this take on [a, b] two arbitrary points x’ and x” and 
write for f, (x) on [z’, z”] the Lagrange formula (see Section 8.9 


of [4]). 
By the Lagrange theorom, there is a point &, on [z’, 2”J such that 
[fn (@")—fn (2") |=] fn (En) | t°— 2" J. (1.38) 


Since {f, (z)} is uniformly bounded on Ja, BJ, there is a constant A 
such that for all n 


| fn (En) |RA. (1.39) 
Substituting (4.39) into (1.38) we get 
Lin (2 —fn (2") | SA fz’ — 2" |. (1.40) 
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Choose any ¢ > 0. Then, taking 6 = ¢/A and using (t. 40), we get, 
for all x and for all x’ and x” of {a, b] related by | 2’ —z” |<4, 
the inequality 


| fn (2") — fn (2") |<. 
The equicontinuity of {f, (z)} is thus proved. 


sin 





, ne , ; . 
As an example consider a sequence } . This sequence is equicon- 


tinuous on any closed interval [a, 0], for the ceaente of derivatives {cos nz} 
is uniformly bounded on any closed interval [a, b 


Remark*4, The concept of equicontinuity can be formulated not 
only with respect to the closed interval [a, 5}, but also with respect 
to the open interval, half-open interval, half-line, an infinite straight 
line andjwithjrespect to any set dense in itself in general*. Moreover, 
this notion may be applied not to the sequence of functions but to 
any infinite number of functions. 


1.4, POWER SERIES 


1.4.1. A power Series and itsdomain of convergence. A power series 
isa ene series of the form 


M+ 2) pat Ay x” = Ay aya dor? + 66. Ont "+ ..., (1.41) 


Where Gp, G3, Go, -- ...» are constant real numbers called the 
coefficients of the series “. 41). Let us try and see what the domain of 
convergence of any power series looks like. 

Notice that any power series converges at a point x=0Q, there 


existing pover series converging only at that point (for example, 
Cc 
the series >) k!-z* does). 


hai 
Form the following number sequence using the coefficients a, of 
(1.44): 


(Tan l} (m=4,2,...5. (4.42) 


There may occur two cases: (1) the sequence (1.42) is unbounded; 
(2) (1.42) is bounded, 

In case (2) the sequence (1.42) has a finite upper limit (see Section 
3.4.3 in [4]) which we denote by DL. It should be stressed that the 
upper limit L is automatically nonnegative (for all the elements of 
(4.42) and therefore any limit point of this sequence are nonnegative). 


* The Arzela theorem remains valid if we replace the closed interval [a, 5] 
by any closed bounded set in the theorem, 


4 Fundamentals of Mathematical Analysis 


Summarizing we come to the conclusion that the following three 
cases are possible: (I) the sequence (1.42) is unbounded; (II) (1.42) 
is bounded and has a finite upper limit L > 0; (III) (41.42) is bounded 
and has an upper limit L = 0. 

Now we prove the following remarkable statement. 

Theorem 1.13 (Cauchy-Hadamara). 

J. I} the seguence (4.42) is not bounded, then the power series (4.44) 
converges only when x = 0, 

Il. If the sequence (1.42) is bounded and has an upper limit L > 0, 
then the series (4.41) absolutely converges for values of x satisfying the 
neaty [2 |< 1/L and diverges for values of x satisfying |x |> 
> IL. 

Ill. /f the sequence (4.42) is bounded and its upper limit L = 0, 
then the series (1.41) absolutely converges for all values of x. 

Proof. 

J. Let (41.42) be unbounded. Then for z =< 0 so is the sequence 


zt 7 fan] =i Tanz" |, 
i.e. this sequence has elements with arbitrarily large n satisfying 
Y Tana [>i or Jagex") >. 


But this means that the necessary condition of convergence fails for 
the series (1.44) (with 2 540) (see Section 13.4.2 in [4]), i.e. (4.44) 
diverges when z = 0. 

IT. Let the sequence (1.42) be bounded and let its upper limit 
L> 0. We prove that (1.41) absolutely converges when | z | < 1/L 
and diverges when |z [> 1/2 

(a) First choose any a satisfying {az |< 4/L. Then there is ¢ > 0 
such that Jz ]< < AML + ce). By the properties of the upper limit 
all elements {/ [a, | beginning with some n satisfy 

£ 


us | @;, fa,J<L+-. 


Thus, beginning with this n, 


Les 
Yana" (=e 17 lanl <pee <1, 


i.e. the series ray absolutely converges by the Cauchy test (see 
Section 13.2.3 in [4]). 

(b) Now choose any z satisfying | x [> 1 

Then there is e>>0 such that Jz}> Winans By the definition 
of the upper limit we may choose a subsequence {7 V Tan, 1} (i= 


=14, 2,...) of the sequence (1.42) converging to ZL. 
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But this means that, beginning with some /, 
L—e<'¥ [an,| <L+e. 


Thus, beginning with that k, 
ry ———______. n = 
VY |an,-2*| =|21+ Tan, | >foe=l 


or 
| dp, -2"* | > 4, 


i.e. the necessary condition for the convergence of the series (1.44) 
fails and the series diverges. 

III. Let the sequence (1.42) be bounded and let its upper limit 
L = 0. We prove that (1.41) absolutely converges for any z. 

We choose an arbitrary z +4 0 (when z = 0 the series (1.41) auto- 
matically converges absolutely). Since the upper limit L = 0 and 
the sequence (1.42) cannot have negative limit points, the number 
L = 0 is the only limit point and therefore it is the limit of that 
sequence, i.e. (1.42) is infinitesimal. 

But then for any positive number 1/2 | x | there is an integer begin- 
ning with which 


———: 1 
VW Tan 1<TeT- 
Therefore, beginning with that integer, 
— ——_ 1 
VY [ant |= !21-/ Tan l<o<t, 


i.e. (4.44) absolutely converges by the Cauchy test (see Section 
43.2.3 in [1]). This completes the proof of the theorem. 

The theorem leads to the following fundamental statement. 

Theorem 1.14. For every power series (1.41), unless it is one converging 
only at a point x = 0, there is a positive number R (possibly equal to 
infinity) such that that series absolutely converges when |x |< R and 
diverges when |x |>R. 

The number R is called the radius of convergence of the series and 
the interval (—R, R) is the interval of convergence of the series. The 
radius of convergence is computed from the formula 


He Se (4.43) 


(when lim / Ja,|=0, R=0o). 


N-+0o 
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Remark {, At the end points of the interval of convergence, i.e. at 
the points r = —R and z = R. a power series may be both con- 
verzent and divergent™. 


~< 
Thus the series 1-L “’ z* has a radius of convergence equal to 
tok 
unity and the interval of convergence of the form (—1, 1) and 
converges at the end points of the interval. 


~ 


The series >) 
Kent 
but converges at both end points of the interval. 

Remark 2, All the results of this subsection hold for a series (1.41) 
in which the real variable z is replaced by a complex variable <. 

For such a series we can establish the existence of a positive 
number # such that the series absolutely converges when |s |< R 
and diverges when [2 | > /. 

To compute #@ we use formula (1.43). The number 2 is called tho 
radius of convergence of the series and the region {2 {<A is the 
circle of convergence of the series. 

1.4.2. Continuity of the sum of a power series. Let a power series (1.41) 
have the radius of convergence R > 0. 

Lemma 2, Given any positive number r satisfying the conditionr <f, 
the series (1.41) uniformly converges on a closed interval [—r, r}, i.e. 
when [xz |<r. 

Proof. By Theorem 1.14 the series (1.41) absolutely converges 
whens =r, i.e. 


zh A 
> + has tho same interval of convergence, (— 1, 4), 


bdo} XS bay jer 
converges. But this number series serves as a majorant of (1.41) for 
all z of [—r, r]. By the Weierstrass test, (1.44) converges uniformly 
on [—r, r}. Thus the lemma is proved. 

Corollary. Under the hypotheses of Lemma 2 the sum of a series (1.41) 
is a function continuous on a closed interval [—r, r] (by Theorem 1.7). 

Theorem 1.15. The sum of a power series is a continuous function in 
the interval of convergence of the series. 

Proof. Let S (xz) be the sum of a power series (1.41) and Iet R 
be its radius of convergence. Wo take any z in the interval of con- 
vergence, i.e. such that |z |< A. There is always a number r such 
that |z | <r< RR. By the corollary of Lomma 2, S (z) is con- 


* Note the following theorem of Abel: if the power serles Gat) converges when 
z= fh, then itssum S (z) ts continuous at the point R from the left. We may assume 
without loss of generality that 2 = 1, but in this form Abel's theorem (asserting 
in fact ‘the jregularity of the Abel-Poisson summation method) is proved in 
Supplement 3 to Chapter 13 in [f]. 


Ch. 1. Funetional Sequences and Functional Series 43 


tinuous on [—r, r]. Therefore S (x) is continuous at z too. Tho theorem 
is proved. 

1.4.3. Term-by-term integration and term-by-term differentiation 
of a power scries. 

Theorem 1.16. If R >0 is the radius of convergence of a power scries 
(1.41) and x satisfies the condition |x |< R, then (1.44) can be in- 
tegrated term by term. over the closed interval [0, x). Lhe resulting series 
has the same radius of convergence R that the original series has. 

Proof. For any z satisfying the coneitien jx ]< R we can find r 
such that Jz | <r<R. By Lemma 2, (4. 41) convorges uniformly 
on [—r, r] and hence on [0, z]. But then, by Theorem 1.8, that sorics 
can be integrated over [0, 2] term hy torm. 

Integrating term by term yiolds a power scrics 


a ane 
Apt boy eee pm se ee 


whose radius of convergence, by Theorem 1.14, is the invorse of the 
upper limit of the sequence 


Lane; } _¥ cea 
77 ieee ast ara ’ (1.44) 


Since the uppor limit of (1.44) is the same that (4.42) has*, the 
theorom is provod. 

Theorem 1.17. A power series (1.41) can be differentiated term by 
term in its interval of convergence. The resulting series has the same 
radius of convergence R that the original series has. 

Proof. It is sufficient (by Theorom 1.9 and Lemma 2) to prove 
only the second statemont of tha theorem, 

Differentiating (4.41) term by term yiolds a serics 


O,+2-a,rt..etneay 29+ (n +41) edna 27+... 


whose radius of convergence (by Theorem 1.14) is the inverso of the 
upper limit of the sequence 


(Y/ (a+ 4) lanai I). (1.45) 


* For lim /n=4, Jim Viana l= iim ky Seem 


Teo 


= Tim (Vfant] mH = Tim (7/Tant I 
n-+oO TM-00 


f 
mY 


ts 
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Since (4.45) has the same upper limit that (1.42) has*, the theorem 
is proved. 

Corollary. A poier series can be differentiated term by term as many 
times as we like in its interval of convergence. 

The series resulting after n-fold term-by-term differentiation of the 
original series has the same radius of convergence that the original series 
has. 


1.5. POWER SERIES EXPANSION OF FUNCTIONS 


1.5.1. Power series expansion of a function. 

Definition 1. We shall say that a function j (x) can be expanded into 
@ power series on an open interval (—R, R) (on a set {x}) if there is 
a power series converging to f (x) on (—R, RR) (on {z}). 

The following statements are true. 

1°, For a function f (z) to allow expansion into a power series on an 
open interval (—R, R), it is necessary that it should have continuous 
derivatives of any order on (—R, R)**. 

Indeed, a power series can he differentiated term by term as many 
times as we please in its interval of convergence which in any case 
contains the open interval (—&, #), all the resulting series con- 
verging in the same interval of convergence (Theorem 1.17). 

But then the sums of the series obtained by differentiating as 
many times as we please (by Theorem 1.15) are functions continuous 
in the interval of convergence and are therefore continuous on 
(—R, R). 

2°, Ifa function f (x) can be expanded into a power series on an open 
interval (—R, R), this can only be done in a unique way. 

Indeed, Jet f (x) be a function that can be expanded on (—F, FR) 
into a power series (4.44). 

Differentiating (1.41) term by term m times (which can trivially 
be done in the interval (—2, R)) we get 


{™ (2) = agen! + dnay (n+ Lz! 4-0... 





* For limj“n- 44, lim lang 1 = 
n-~c nwo 
i nn 
Freese Sed Trt rt yn PLY arama 
=fim "¥Vanl= lim {)/fanl }"-! = Tim 4/Tan T- 
T-50 Tl oS Neo 


** Note that there are functions that have continuous derivatives of an 
order on (--#, 7) but cannot be expanded into a power ‘series on that interval, 
As an illustration 


e7 {f* when z=: Q, 
H(r={ 
0 when --.0. 
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From which for + = 0 we find 
f™ (0) =anen! 


or 
n 
a, = (1.46) 

Thus the coefficients of (1.44) into which we can expand } (2) are 
uniquely defined by formula (1.46). 

Suppose now that f (x) has continuous derivatives of any order on 

—R, R). 
Definition 2. A power series (1.41) whose coefficients are defined by 
formula (1.46) are called a Taylor series of the function f (x). 

Statement 2° leads us to the following statement. 

3°. If a function f (x) can be expanded into a power series on an open 
interval (—R, R), that series is a Taylor series of the function f (x). 

In conclusion we formulate the following statement immediate 
from Section 8.14 of [4]. 

4°, For a function f (x) to allow expansion into a Taylor series on an 
open interval (—R, R) (on a set {x}) it is necessary and sufficient that 
the remainder in the Maclaurin formula for that function should tend 
to zero on (—R, R) (on {a}). 

1.5.2. Taylor expansion of some elementary functions. It was 
proved in [4] (see Section 8.15.2) that the remainders in the Maclaurin 
formula for the functions e*, cos z, and sin x tend to zero on the 
entire infinite straight line and that the remainder in the Maclaurin 
formula for the function In (1 + z) tends to zero on the half-open 
interval —1 <2 < +41. 

By Statement 4° of the preceding subsection this brings us to the 
following expansions: 


e* == 44 Y =, 


n=1 


4)n gan 


cost=1+ 5) Sr 
n=l 


= (—4)" gent 
sinz= >) Gti? 
n=0 


ce (—~1)n4 on 
niso=)) >a 


n=1 


first three of these converge for all values of x, whi 
sca nese for the values of in -1<2¢< 1, tile the last 
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Now we discuss power series expansion of the function ({ +- z)* 
or what is called a binomial serics. 

Ye f(z) = A =- 2)% then 

FO (zr) = a (a —1)(@e— 2)... (a —n + 1)-(4 + x)e-r. 
The Maclaurin formula with remainder in ate Cauchy form is there 
fore of the form (see Section 8.44 of [4]) 


he! 
where 
Rass (Z)= uo" x8. FP) (Oz) = 
= HOO ott (x —1) An (a—n) (4+62)7-" = 
=(+5 Ne SEE leet oy las (1.48) 


(8 is some number in the interval 0 < 0 < 1). 
We first show that when a@ > 0 the remainder Ry, (z) tends to 
zero (as n — oo) everywhere on —1<2r<1. 


8 


Indeed, the clements of {(7=e are al] not greater than 


unity anywhere on —1<2<1; aD eA) oo en) is bound- 
ed for any given a>0*; the number atl 4-Oz)¢-! is defined 
for any given a@>0 and any zx in the interval —1<2<-+-4; 
finally the sequence {z"4!} is infinitesimal for any z in —i< 
<a<l. 

Thus by (4.48) the remainder ?,+; (z) tends to zero for any given 
a> Oand any gin —-t1<r<i. 

By (1.47) therefore, when «@ > 0, everywhere on —1<r<t1 we 
have 


ow 
, a({a—i)... (a—k-+1 
(itz)?= 41+ 5) ae ee a (1.49) 
hed 
Now we prove ( that when @ > 0 the series on the right of (4.49) untjormly con- 


verges te (1 =- z)© on the closed Interral ~1 < 21 
Everywhere on this interval the series is majorized by the following number 
series: 


2 fat-[ime]... [se—1—a lf 
ee ge (1.50) 


© AN] the elements of the scquence are bounded in absclute value by the 
(a— f) (a2— 2)... (2—Ja}) 


nher 
nu jay! 


, Where [e] is the intcgral part of a. 
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By the Weierstrass test, to establish uniform convergence on ~1 <2 <i 
of the series on the right of (1.49) it is sufficient to prove the convergence of the 
majorant series (1.50). 

Denote the kth term of (1.50) by p,. Then for all Jarge enough’k ‘we get 





Phy k—-a _, _ fite 
yes cs ee (et) 


This yields 


“ k 
)=d-+e)s him EFA =ita>t1, 








oe (4 Phat 
les z (: Ph 


i.e. (4.50) converges by the Raabe test (see Section 13.2.5 of [4]). 

We have thereby proved that when « > 0 the series on the right of (1.49) 
converges uniformly on —1 <2z<1. It remains to prove that that series 
converges on —1 <z <1 to (4+ 2)% 

By what was proved above the sum of the series on the right of (1.49), S (z), 
and the function (1 + 2)™ coincide everywhere on —i <2 <1. In addition 


both functions, § (z) and S ++ 2)", are continuous on —1 <x <1 (the function 
S (z) as the sum of a uniformly convergent series of continuous functions; the 


continuity of (4 + 2)* is obvious when a > 0). 
But then the values of S (x) and (1 -+ z)% at zs = —1 and z = 1 must coin- 


cide, i.e. the series on the right of (1.49) uniformly converges to (i -+ z)“ on 
-—l1<2r<i. 


1.5.3. Some elementary facts about the functions of a complex 
variable. As already noted above, we may extend to the case of 
a power series in a complex variable z 


Ap aye 4527+ 1... +apo"+... 


Theorems 1.13 and 1.14 (on the existence and value of the radius of 
convergence). Series of this type are used to define the functions of 
a complex variable z. 

The functions e, cos z, and sin z of z are defined to be the sums 
of the following series: 





@=i+ > = : (1.52) 
n=1 
cosz=1-+ >! a, (1.53) 
n=1 


(—4)n.z2nti 


sin z= yy “Gri (1.54) 
n=0 ' 


It is easy 1o verify that these three series absolutely converge for 
all values of z (their radius of convergence R = oo). 

Now we establish the relation between the functions e*, cos z, and 
sin 2. 
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Replacing < by is in formula (4.52) we get 


senda walleNe: So Mie) e ae Cie oye Cia) e rae 


ese {+-iz Ss ieee y Wa IR aie 


BE a ICES BGR es ee 
Lee Gh 23 ee zs 
=(1-4-4+4-...)+i (s-4-+4—--.-). (1.55) 


Comparing the right-hand side of (41.55) with the expansions 
(1.53) and (1.54) we arrive at the following remarkable formula: 


e* == cosz + i-sins. (4.56) 


Formula (1.56) plays a fundamental part in the theory of functions 
of a complex variable and is called Kuler's formula. 

Setting in Euler's formula the variable = first equal to a real z 
and then to a real —z we obtain the following two formulas: 


e* = cosx -+i-sinaz, e7!* = cosxz —isinaz. 
Adding and subtracting these we obtain formulas expressing cos z 
and sing in terms of an exponential function: 
ef Xo eckx 
cos z= ——_—, 
3 efx—erix (1.57) 
Sil eee reamed 
inz oT 
In conclusion we shall discuss the definition of the logarithmic function 
u: = Inz of the complex variable s. It is natural to define this function as the 
inverse of the exponential, i.e. by the relation s = e*. Putting w == u - tv, 
z= = -> ty we intend to express u and v in terms of 2 = x -{ ly. 
From the relation 


fare iy = evtiv = et (cos u 4- i sin v) 
we get, using the concepts of the modulus and argument of a complex number 
(sce formula (7.6) in [1]), 
jel=VEppiaet, args-v—2nhk, 
where 
k= Q, &4, 3:2, 2... 
Froin these equations we find that 
we=in |e fe=In jz? sy?, 
vrarges-20k (= 0, 71, #2,...) 
or, finally, that 
Ine = In| sc| +i (args + 2h), whore k ==: 0, +1, +2,.... (1.55) 


Formula (1.58) shows that the logarithmic function is not single-valued in the 
complex domain: its Imaginary part has an infinite number of values corres- 
ponding to different k = 0, 1, 2:2, ... for the same value of =. 

It is easy to realize that a similar situation will arise when inverse trigono- 
metric functions are defined in the complex domain. 
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1.5.4. Uniform approximation of a continuous function by poly- 
nomials (the Weierstrass theorem). In this subsection we shall prove 
ee theorem due to Weierstrass who established it in 

Theorem 1.18 (Weierstrass). If a function f (x) is continuous on a 
closed interval {a, b], then there is a polynomial sequence {P,, (x)} 
uniformly converging on [a, b] to f (x), i.e. given any « > 0, there is 
a polynomial P, (x) with an integer n dependent on « such that 


1P, (2) —f()|<e 


at once for all x in fa, b). 

Restated, a function f (x) continuous on a closed interval [a, b] 
can be uniformly approximated on {a, b] by a polynomial with a preas- 
signed accuracy e. 

Proof. Without loss of generality we may consider a closed interval 
[0, 1] instead of {a, b]*. Moreover, it is sufficient to prove the theorem 
for a continuous function f (x) vanishing at the ends of [0, 4], i.e. 
satisfying the conditions f (0) = 0 and f (1) = 0. Indeed, if f (z) 
did not satisfy these conditions, then on putting 


g (x) = f(z) -—f0)— aff) -—7O) 


we should obtain a function g (x) continuous on [0, 4] and satisfying 
the conditions g (0) = 0 and g (1) = 0, and it would follow from 
the possibility of representing g (x) as the limit of a uniformly con- 
vergent sequence of polynomials that f (x) can also be represented as 
the limit of a uniformly convergent sequence .of polynomials (for 
the difference f (x) ~ g (z) is a first-degree polynomial). 

So let f (x) be a function continuous on [0, 4] and satisfying the 
conditions f (0) = 0, f (1)=0. We may extend such a function to 
the entire infinite straight line by setting it equal to zero outside 
[0, 1] and state that a function extended in this way is uniformly 
continuous on the entire infinite straight line. 

Consider the following particular sequence of non-negative poly- 
nomials of degree 2n: 


Qn (x) = Cy (4—2")” (n=1, 2, swedy (1.59) 
each having a constant c, chosen so that 
4 
\ Q,(z)de=1 (n=41,2,...).- . (4.60) 
a 
We majorize c, without computing its exact value. _ 


* Since one of the intervals transforms to the other by linear substitution 


: 


‘ge(6—ai+ea. 
4-01684 
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To do this we notice that for any n = 1, 2,... and all zin [0, 4] 
we have the inequality* 


(A — x7)" > 1 — nz’, (4.64) 
Using (1.61) and the fact that ifn <4 for any n > 1 we havo 
t t Wa 
\ Q—22)?dr=2\ U—2ytde>2 | (1—2)dr> 
“1 0 0 

oe 44 1 

2 opie eS eee 

ei) (1—n2") dr=3 =>. (1.62) 


From (1.59), (1.60), and (41.62) wo derive that given any xn = 
= 1, 2,... the following upper estimate holds for ¢,: 

et, < Vn. (4.63) 

From (1.63) and (1.59) it follows that given any 6 > 0, for all z 
in 6S r<1 we have 

0<On(z)<Vn (4-82)? (4.64) 


From (1.64) we deduce tha given any fixed 5 > 0 the sequence of 
nonnegative polynomials {Q, (x)} converges to zero uniformly on 
Se oie eos gt 

Now for any z inO <2 <1 we put 


Pylzy= \ f(z+2) Qn (t) dt (1.65) 


1 


re 


and show that given any n = 1, 2, ... the function P, (z) is a 
polynomial of degree 2n, with {P, (z)} the desired sequence of poly- 
nomials uniformly converging on O< x <1 to f (zx). 





* This inequality follows from the fact that for any n> 1 the function 
p (z) = (1 ~— 24)? — (1 — nz?) ts nonnegative everywhere on OS x <4, for it 
vanishes when x = 0 ond has a nonnegative derivative @’ (z) = 
== 2nz [1 — ({ -— 2°)?-} everywhere on Or <1. 
** Indeed, it suffices to prove that the sequence a, = (1 — 6)". Wn cone 
verges to zero, and this follows. for example, from the fact that since 
lim 9/@p, == (4 —68%) lim nf/2" — ({ 82) <4, 
no n~@% 
Fas 
the series = a, converges by the Cauchy test (sce Theorem 13.6 in [{}). 
n= 
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Since f (x), the function under study, is zero outside [0, 4], for 
any x of [0, 4] the integral (1.65) can be written as 
i-x 


Pa (a= | F@-+0)Qn (tat. 


=x 


Replacing t by ¢ — z in the Jast integral we get 
4 

P,,(z)= J f(t) Qn (t—2) dt. (1.66). 
0 


It is clear from (4.66) and (1.59) that P, (z) is a polynomial of 
degree 2n. 

It remains to prove that {P,, (z)} converges to f (x) uniformly on 
0O<r<xt. 

We take an arbitrary ¢ > 0. For given c, by uniform continuity 
of f (x) on the entire infinite straight line, we can find 6 > 0 such that 


Lf(@)—fw) |< when [z—y|<6. (4.67) 


We further notice that since f(z) is continuous on [0, 4), it is 
also bounded on that interval] and therefore everywhere on the infinite 
straight line. This means that there is a constant [A such that for 
all z 


If@l< (4.68) 


Using (1.60), (4.64), (1.67), and U. 68) and the non-negativeness of 
Q (x) we evaluate the difference P, (x) — f (2). 
For all zinO0 <2 < 1 we have 


1 
[Pa (2)—f (@) [=| J fe +9—F 1 On ( at < 
“4 
1 -6 
<J If (e+#)—F(2)1 Qn (t) dt<2A | Qn (4) d+ 
-1 ~-1 


& 


1 
+5 | Q.@dt+24 | Q,(a< 
6 


Teo 
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To complete the proof of the theorem it suffices to notice that for 
all large enough n 


4A\n (1-8)"< 4. 


Corollary. If not only the function f (z) itself, bit also its derivatives 
up to some order kt inclusively are continuous on a closed interval {0, 1}*, 
then there is a sequence of polynomials {P, (x)} such that each of the 
sequences {P,, (x)}. {Pn (z)}, .. ., {PY (z)} converges uniformly on 
{0, 4] to f (x), f’ (x), .. «yf? (x) respectively. 

Indeed, we may assume without loss of generality that each of the 
functions f (x), f’ (z), .. «1 f(z) vanishes when x = 9 and when 
x= 1%", and under such conditions 7 (z) can be extended to the 
entire infinite straight line by setting it equal to zero outside [0, 4], 
so that the extended function and all of its derivatives up to order i 
inclusively turn ont to be uniformly continuous on the entire infinite 
straight line. 

But then. denoting by P, (x) the same polynomial (1.65) as above 
and repeating the arguments used in proving Theorem 1.18, we 
establish that each of the differences 


Py(r)—F (x), Prlz)—P’ (x), «2. PR (z)— J (2) 


is an infinitesimal uniform in zon0<2<1. 

Remark 4, The above proof can be easily generalized to the case 
of a function of m variables f (xy, 2, . . -, 2m) continuous in an m-di- 
mensional cube O< 7, <1 (i = 1, 2, ..., m). 

In full analogy with Theorem 1.18 it can be proved that for such 
a function f (21, 2s, - «++ Zm) there is a sequence of polynomials in m 
variables 2, Za, . . -» 2 uniformly converging to it in the m-dimen- 
sional cube. 


Remark 2. Notice that the polynomials of Theorem 1.18 may be replaced by 
functions of a more general nature while retaining the statement about the 
SRP of uniform approximation by such functions of any continuous 

unction f. 

Let us agree to say that an arbitrary collection A of functions defined on some 
set £ is an algebra if*** (1) f+ @ € A; (2) f-e € A; (3) @-f A for arbitrary 
J€A and g€A and for any real a. 

In other words, an algebra is a collection of functions closed under addition 
and tpultiolication of functions and under multiplication of functions by real 
numbers. 





* Of course we may take [a, LJ] instead of [0,1]. 
** If f (x) failed to satisfy these conditions, we rhould find a polynomial 


Py, (z) of degree 2h such that these conditions would hold for g(r) = f(z) — 
— Py (zr). 
© We recall that the symbol j € A means ‘f helongs to A’. 


Ch, 1. Functional Sequences and Functional Series 53 


If for each point x of E there is some function g € A such that g (x) = 0, the 
algebra A is said to vanish at none of the points x of E. 

A collection A of functions defined of a set E is said to separate the points of E 
if for any two distinct points 2; and z, of the set we can find a function of A 
such that f (21) <4 f (zo). 

We come to the following remarkable statement called the Stone-Weterstrass 
theorem™. 

Let A be an algebra of functions continuous on a compact** set E that separates 
the points of E and vanishes at no point of that set. Then every function f (x) con- 
tinuous on E can be represented as the limit of a untformly convergent sequence of 
functions of A. 


* M. Stone is a modern American mathematician. 
** Recall that a compact set is a closed bounded set 


CHAPTER 2 


DOUBLE INTEGRALS AND n-FOLD 
MULTIPLE INTEGRALS 


In Volume 4 we discussed physical and geometrica) problems 
leading to the concept of single definite integral. 

Typical problems of this kind are the problem of calculating the 
mass of an inhomogencous rod from the known linear density of the 
rod and the problem of calculating the area of a curvilinear trapozoid 

(i.e. the area under the graph of a nonnegative 
z| function y = jf (z) on a closed interval [a, 0)). 
z= f(x,y) It is easy to cile similar “multidimensional” 


problems leading to the notion of double or 
; we triple integral. 
Thus the problem of calculating the mass 


of an inhomogencous body 7 from the known 
volume density p (J) of the body leads us in 
yY anatural way to the concept of triplo inte- 
gral, 
To compute the mass of the body 7, divide 
———__. Tinto sufficiently small parts 7), T,, ..., Tn. 
x Wo may roughly assume the volume density 
Fig. 24 p (7) of each part 7;, to be constant and equal 
to p (A7;,), where AT; is some point of 7,,. In 
this case the mass of cach 7), will be approxi- 
mately equal to p (A7,)-v,, where v, is the volume of 7). 
The approximate value of the mass of the entire body 7 is 


n 
Pa) ee 


It is natural to define the exact value of the mass as the limit of the 
above sum as every part 7), decreases indefinitely.* We may take 
this limit as the definition of triple integral of p (AJ) over a threc- 
dimensional region 7. 

In a quite similar way we may consider the geometrical problom 
of calculating the volume of the so-called curved-baso cylinder 
(i.e. the volume of the body (Fig. 2.4) lying under the graph of the 
nonnegative function z = { (z, y) insome two-dimensional domain D). 


ee 
* Of course the words “decreases indefinitely” should be made more precise. 


Ch. 2. Double Integrals and n-fold Multiple Integrals 55 


This problem leads us to the notion of double integral of a function 
j (x, y) over a two-dimensional domain D. 

In this chapter we present the theory of double, triple and n-fold 
multiple integrals in general. 

To make more effective use of the analogy of the single integral 
we first introduce the concept of double integral for the rectangle 
and only then do we introduce the double integral over an arbitrary 
domain using both rectilinear and absolutely arbitrary subdivision 
of the domain. 


2.4. DEFINITION AND EXISTENCE OF A DOUBLE INTEGRAL 


2.1.4. Definition of a double integral for the rectangle. Let / (z, y) 
be a function defined everywhere on a rectangle R = la < x <b) X 
Xlex<y <4) (Fig. 2.2). 

We divide the closed interval a < x < b into n subdivisions using 
the points a= %<“7,<427,<...< 2, = bandc<y< d into 
p subdivisions using the pointse = yy»<y<ye<...<y=d 





Key Le Gyr O 





x, Ze 





Fig. 2.2 


Corresponding to subdivision by straight lines parallel to the z 
and y axes (see Fig. 2.2) is a subdivision of a rectangle R into n-p 
subrectangles 


Rryr= (Tp SeGx_) X (YS y Sy] 
(k=1,2,...,m3 b=4,2 ..., p). 


This subdivision of R will be designated by the symbol 7. 
Throughout what follows in this chapter, by “rectangle” we mean 
a reclangle with sides parallel to the coordinate axes. 
On every subrectangle Hy: we choose a point (Ex, 11). Putting 
AZy = Z_ — Troy, AYI = Yr — Y1-1, denote by AR, the area of a 
rectangle Ry, Obviously ARn; = Az, Ayr. 
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Definition 1, The number 


no oF 
z 


gx NON GCE, WAR (2.1) 
hea} lect 


is called the integral sum of a function f (z, y) corresponding to a given 
subdivision 7 of a rectangle R and a given choice of intermediate points 
(E,, na) on the subrectangles of T. 

The diagonal] (Ar) + (Ay,)* will be called the diameter of a 
rectangle 22, ;. The syinbol A will designate the Jargest of the diameters 
of all subrectangles 2?) :. 

Definition 2. The number J is said to be the limit of the integral 
sums (2.4) as A 0 if given any positive number ¢ we can find a 
positive number § such that for A <4, regardless of the choice of points 
(€), Qi) on subrectangles Ry, we have 


Jo—T|<e, 


Definition 3. A junction f(z, y) is said lo be integrable (in the sense 
of Riemann) on a rectangle R if there is a finite limit I of integral sums 
of f(z, y) as A—>0. 

The limit ] iscalled a double integral of f(z, y) over R and is designat- 
ed by one of the following symbols: 


T= {{ f(z, acdy= Jf fanas. 
“Ht R 
Remark. Just as for a single definite integral (see Section 10.1 of 
{1]), it can be established that any function f (x, y) integrable on a 
rectangle R is bounded on that rectangle. 

We are thus justified in considering only bounded functions 
j (x, y) in what follows. 

2.1.2. Existence of a double integral for the rectangle. Darboux s 
theory developed in Chapter 10 of [4] for the single definite integral 
can be extended in full to the case of the double integral in the 
rectangle J?. In view of close analogy we restrict ourselves to a general 
outline of the arguments. 

Let AJ, ~¢ and mp, be the supremum and infimum of a function 
/(z, y) on a subrectangle 2); Form for the given subdivision T 
of & two sums 

the upper one 


n P 

S= MY My AR 
heat tend 

and the lower one 
n 2, 

se DN mr ARne 


derh det 
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The following statements hold (their proofs are quite similar to 
those given in Section 10.2.2 of [4]). 

1°. For any fixed subdivision T and any ¢ > 0 we can choose inter- 
mediate points (€;, 1) on subrectangles R;,, so that the integral sum o 
satisfies the inequalities O<0 S —~o<eé. 

Points (En, 2) can also be chosen in such a way that the integral sum 
satisfies the inequalities 0<o —s<eé. 

2°. If a subdivision T’ of a rectangle R is obtained by adding new 
straight lines to the straight lines generating the subdivision T, then 
the upper sum S' of T' is not greater than the upper sum S of T, and. 
the lower sum s’ of T’ is not less than the lower sum s of T, i.e. 


s<s’', S'<S. 


3°. Let T’ and T” be any two subdivisions of a rectangle R. Then the 
lower sum of one of them does not exceed the upper sum of the other. 
That is, if s’, S’ ands”, S” are respectively the lower and upper sums of 
I" and T", then 


<8", s"<S'. 


4°. A set {S} of the upper sums of a given function f (x, y) for all 
possible subdivisions of a rectangle R is bounded below. A set {s} of the 
lower sums is bounded above. 

Thus there are numbers 


T= inf {5}, I=sup {s} 


called respectively the upper and lower Darboux integrals (of the 
function f (x, y) over R). _ 

It can easily be seen that J</. 

5°. Let T’ be a subdivision of a rectangle R obtained from a sub- 
division T by adding to it p new straight lines and let s’, S’ and s, S be 
respectively the lower and upper sums of T' and Tf. 

Then for the differences S — S’ and s’ — s we can obtain an estimate 
dependent on the maximum diameter A of a subrectangle of the sub- 
division T, the number p of the straight lines added, the supremum and 
infimum M and m of the function f (z, y) on R and on the diameter 
ad of R. 

That is, 


S—S'<(M —m)-p-A-d, 
Ped 


s' —s<(M — m)-p-A-d. 


° 
4 
a 
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6°, The upper and lower Darboux integrals I and I of a funetion 
jf (x, uv) over a rectangle R are respectively the limits of the upper and 
lower sums as A — 0*. 

The following main theorem results from properties 4° to 6°. 

Theorem 2.1. For a function f(x, y) bounded on a rectangle R to be 
integrable on R it is necessary and sufficient that given any & > 0 
there should be a subdivision T of R for which S —s<e. 

As in Chapter 10 of [4], Theorem 2.1 in conjunction with the 
theorem on the uniform continuity of a function allows us to distin- 
guish major classes of integrable functions. 

Theorem 2.2. Any function j (z, y) continuous in a rectangle R is 
integrable on R. 

Definition 1, We give the name of an clementary figure to a set of 
points that are a sum ofa finite number of rectangles (with sides parallel 
to the x and y azes)**. 

Defenition 2. We say that the function f(z, y) has the 1-property in 
arectangle R (in an arbitrary closed domain D) if: (4) f (x, y) is bounded 
in3R (in D); (2) given any ¢ > 0 we can find an elementary figure that 
contains all the points and lines of discontinuity of f (z, y) and has the 
area less than e. 

Theorem 2.3. If afunction f (z,y) has the I-property in a rectan- 
gle R, then it is integrable on R. 

The proofs of Theorems 2.2 and 2.3 are quite similar to those of 
Theorem 10.3 and Theorem 10.4 in [1]. 

2.1.3. Definition and existence of a double integral for an arbitrary 
domain. In Section 11.2.4 of {{] we introduced tho squarability 
and area of a plane figure Q. These notion can he carried over without 
any modifications to the case of an arbitrary bounded set Q of points 
in the plane. 

In all tho definitions and statements of Section 14.2.4 of [4] wo 
could take an arbitrary bounded set Q instead of the figure Q. 

In that section we also gave a definition of a curve (or the boundary 
of a figure) of cero area: f is called a curve of zero area if given any 
e > 0 we can find a polygon that contains al] points of T and has an 
area less than e. 


* The concept of the limit cfupperor lower sums is defined in full analogy 
with the notion of the limit of integral sums, That is, the number J is sald to be 
the Umit of upper sums S as A + 0 if given any & > 0 we can find 6 > 0 such 
that | S—J},<e for A< 8S. 

** Notice thata sum of a finite number of absolutely arbitrary rectangles 
(with sides parallel to the z and y axes) can be represented as a sum of an also 
finite number of rectangles having no interior points in common (with sides paral- 
Iel to the above axes). In Definition 1 therefore we can take rectangles both 
with and without common interior points. 
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Note that in the definition “polygon” can be replaced by “elemen-~ 
tary figure”. This follows from the fact that any elementary figure is 
a polygon and any polygon with area less than e is contained in an 
elementary figure having an area less than a number 8e*. 

It is easy to prove the following statement. 

If T is of zero area and if the plane is covered with a square net with 
spacing h, then given any & > 0 we can find h > 0 such that the sum 
of the areas of all the squares having points in common wiih T is less 
than &. 

Indeed, given any ¢ > 0 we can find some elementary figure Q 
containing I‘ inside itself and having an area less than e/4. After 
that it remains to notice that with 
the spacing of the square net h ¥ A 
sufficiently small, all the squares R 
having {points in common with T 
are contained in the elementary 
figure resulting from replacing every 
rectangle @ by a twice as large rec- 
tangle with the same centre. 

It should be stressed that the class 
of zero-area curves is very vast. 
Belonging to this class, for example, 
is any rectifiable curve (see Theo- ; 
rem 14.3 in [4]). Fig. 2.3 

We now proceed to define the 
double integral for an arbitrary two-dimensional domain D. 

Let D be a closed bounded domain whose boundary I has zero 
area and let f (x, y) be a function defined and bounded in D. 

Denote by A any rectangle (with sides parallel to coordinate axes) 
containing the domain D (Fig. 2.3). 

We define in & the following function: 


f (x, y) at the points of D, 


F (z, n={ 0 at the other points of R. (2.2) 


Definition. A function f (x, y) will be said to be integrable in the 
domain D if the function F (x, y) is integrable in the rectangle R. 


* Indeed, (4) a polygon is equal to a finite sum of triangles; (2) every triangle 
equals the sum (or difference) of two right-angled triangles; (3) a right-angled 
triangle is contained in a rectangle twice as_large in area; (4) any ete a equals 
the sum of a finite number of squares and one rectangle the ratio of whose sides 
is between 4 and 2; (5) any square is contained in a square twice as large in area 
and with sides parallel to the z and y axes; (6) any rectangle with ratio of its 
sides between 1 and 2 can be completed to a square and is therefore contained 
in a square four times as large in area and with sides parallel to the z and y axes. 
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The number J = \ { F(z, v) dx du will be called a double 


kK 
integral of f (x, v) over D and designated 


= ( ( T(x, u)dzdy= ( \ 7 (Mj) do. 


D “p 


Remark 1. From this definition it follows at once that | \ 1-dxr dy 
is equal to the area of D. Indeed, subjecting the corresponding rect- 
angle J? to smaller and smaller subdivisions we find that the upper 
sums of the subdivisions are equal to the areas of the elementary 
figures containing D and the lower sums to the areas of the elemen- 
tary figures contained in D. 

Remark 2. Let the function f (x, y) be integrable in a bounded squar- 
able domain D, let the plane be covered by a square net with spacing h, 
let Cy, Co, . «+s Onn) be the squares of the net contained entirely in D, 
Jet (€), 1.) be an arbitrary point of a square C;, and m, = mt f(z, y) 

h 


(= 41,2,...,0 (lt). Dhen each of the sums 


n(h) n(n) 
Sf (Ene a), Som he? 
h-=4 he=t 


rad 


has a limit ash -—-0 equal to [ | f (x, y) dz dy. 


D 

To prove this it suffices to notice that the sums differ from the 
ordinary integra] sum (respectively from the lower sum) of a function 
f (z, y) in D only in having no terms corresponding to squares with 
points in common with the boundary I of D, the sum of all the 
absent terms being less in absolute value than the product of the 
supremum Af of the function | f(r, y) | in D and the area S of the 
elementary figure consisting of the squares having common points 
with PT. By the statement proved above S — 0 ash —-0. 

Regarding the definition we have given, the question naturally 
arises as to whether the fact of the existence of a double integral and 
its value J depends (4) on the choice of coordinate axes Ox and Oy 
in the plane; (2) on the choice of a rectangle R on which we define 
the function F (zx, y). 

In the next subsection we shall give another definition of the 
integrability of a function f(z, y) and of the double integral that 
depends neither on the choice of coordinate axes nor on the choice of 
a rectangle J? and prove the equivalence of the two definitions. 

For the time being we shal] demonstrate the following main theorem 
which is almost immediate from Theorem:2.3 and the above definition. 
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Theorem 2.4. If a function f (x, y) has the I-property ina domain D, 
then it is integrable in D 

Proof. For such a function f (z, y) the function F (z, y) defined by 
formula (2.2) has the I-property in the rectangle R. 

Indeed, F (x, y) is bounded in R and all discontinuity points and 
lines of the function either coincide with the corresponding discon- 
tinuites of f (x, y) or lie on the boundary I of D. Since © has zero 
area, the theorem is proved. 

Corollary 1. If a function f(x, y) is bounded in a domain D and has 
discontinuities only on a finite number of rectifiable curves in that do- 
main, then f (t, y) is integrable in D. 

Corollary 2. If f (x, y) is integrable inD and g(x, y) is bounded and 
coincides with i (z, y) everywhere in D except for the set of points of 
zero area, then g (xz, y) is also integrable in D. 

2.1.4. Definition of a double integral by means of arbitrary sub- 
divisions of a domain. In the subsection above we defined the double 
integral on the basis of dividing a domain by straight lines into a 
finite number of subrectangles. Here we shall give another definition 
of the double integral] based on dividing a domain D by curves of zero 
area into a finite number of subdomains of arbitrary form and prove 
this definition to be equivalent to that given above. 

Let D be a closed bounded domain with boundary I of zero area. 
Divide D by means of a finite number of arbitrary curves of zero 
area into a finite number r of (not necessarily connected!) closed 
subdomains D,, Dz, ..., D;. 

Notice that every domain D; is squarable, for its boundary has 
zero area (see Section 11.2 in [4]) and denote by AD; the area of a 
subdomain D;. 

In every subdomain D; choose a point P; (i, ni). 

Definition 1. The number 


= f(P1)-ADy (2.3) 


is called the integral sum of a function f (x, y) corresponding to a given 
subdivision of a domain D into subdomains D; and to a given choice of 
intermediate points P; in the subdomains. 

The diameter of a subdomain D, is the supremum of the distances 
between any two points of the subdomain. The symbol A designates 
the largest of the diameters of the subdomains D,, D,, ..., D,. 

Definition 2. A number I is said to be the limit of the integral sums 


(2.3) as A +0 if given any positive number © we can find a positive 


number & such that for A< 6, regardless : the choice of points P;, 
in subdomains D; 


jo—I|<e, e 
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Definition 3 (general definition of integrability). 

A function f (x, y) is said to he integrable (in (he sense of Riemann) 
in a domain D if there ts a finite limit I of integrable sums o of { (x, u) 
as A +0. The limit I is called a double integral of f (z, y) over D. 

We prove the following fundamental theorem. 

Theorem 2.5, The above general definition of integrability is equiva- 
lent to that given in Section 2.4.3. 

Proof. It is obvious that if a function f(z, y) is integrable accord- 
ing to the general definition of integrability and its double integral 
by that definition is equal to J, then f (x, y) is integrable according to 
the definition of Section 2.1.3 too and has by that definition the same 
double integra) I, 

It remains to prove that if f (z, y) is integrable in D according to 
the definition of Section 2.1.3 and J is a double integral of { (x, u) 
over D by that definition, then for the function / (7, y) there is a 


limit of integral sums Gg equal to J as A +0. 


Denote by M, and m, the supremum and infimum of a function 
f(r, y)ina ‘subdomain D, and consider the upper and Jower sums 


ah 


r 
n oar ye AD, and s= my -AD,. 
oa] 


Since for any subdivision 
sxoss, 


it is sufficient to provo that the two sums S and s converge to I 
as A — 0. 

We wish to prove that given any ¢ > 0 we can find 6 > 0 such 
that_ cach of the sums S and $s deviates from J by Jess than c ns soon 
as A <6. 

Take. an arbitrary e > 0. For this « we can find a subdivision T of 
a rectangle # containing the domain D into subrectangles 2), such 
that for that subdivision 


S—s<y. (2.4) 


Denote by AJ, the supremum | f (z, y) | in D and encloso all tho 
segments of the straight lines generating 7 and the boundary I of 
D tn an elementary figure whoso area is Jess than e/4A1y. 

Then automatically there is a posttive supremum 6 of the distance 
between two points ono of which belongs to the boundary of the 
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elementary figure and the other to the segments of the straight lines 
generating the subdivision 7 or to the boundary I of the domain D*. 

We prove that for the sums S and s of any subdivision of D satisfy- 
ing the condition A < 6 we have 


F<S+5, (2.5) 
s—5<s. (2.6) 


We restrict ourselves to proving inequality (2.5), for the proof of 
(2.6) is similar. is 

Remove from S all terms ,-AD, corresponding to domains D;, 
each failing to be entirely in one subrectangle of the subdivision T. 
All such subdomains D; belong to the above elementary figure, so 
the grand total of the areas of such domains is less than ¢/4M. 


The sum of al] removed terms M,-AD, is therefore less than ¢/4. 
Thus, within the error not greater than é/4, 


S== 51" Af,-AD;, (2.7) 


where the prime means that the sum is taken only over subdomains D; 
lying entirely in the corresponding rectangles of the subdivision T. 

Now we replace on the right of (2.7) the suprema Af, in subdo- 
mains D; contained in a subrectangle R, by the supremum M,, in 
R,. Then we get 


a My-ADi <Q My, -ARn, (2.8) 


where AR, denotes the area of the domain A, equal to the sum of 
all subdomains D, contained entirely in the subrectangle R,. 


All subdomains R; — FR, belong to the elementary figure chosen 
above. Consequently 


2 (AR, —AR,) < aq 


* Indeed, consider two sets: (4) a set_{P} of all the points of the elementary 
i Sola boundary and (2) a set {Q} of all the points of the segments of 7 and 
of the boundary T of D. Both sets {P} and {Q} are bounded and closed. Suppose 
the infimum 6 of the distance p (P, Q) equals zero. Then we can find two sequences. 
of points {P,} and {@,} such that p (2, Q,) ~ 0. By the Bolzano-Weierstrass. 
theorem we may choose convergent subsequences {P},,,} and {Q,,} of {P,} and 
{Q,}, whose limits P and Q (by closure) belong to {P} and {Q} respectively. But 
then p (P, Q) = 0, i.e. the points P and Q coincide, which i impossible, for the 
set {Q} lies strictly inside the elementary figure and has no common points 
with {P}. The contradiction obtained proves that 6 is positive. 
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and therefore 


|S = SMe AR, [=[S Mh (ARAB) <t. 
h L 


Thus, within the error not greater than e/4, 


N Ane AR, = 8. (2.9) 


Comparing equations (2.7) and (2.9), which hold within the error not 
greater than c/4, with (2.8) we obtain inequality (2.5). 

The proof of inequality (2.6) is similar. 

From (2.5) and (2.6) we get 


s— SSS S<S+ 5. (2.10) 


Since by (2.4) cach of the sums s and § deviates from J hy less than 


c/2, each of the sumss and S, by (2.10), deviates from J by less thane. 
The theorem is proved. 


2.2, BASIC PROPERTIES OF THE DOUBLE INTEGRAL 


The properties of a double integral (and their derivation) are 
quite similar to the corresponding properties of a singlo definite in- 
tegra). Therefore we restrict ourselves to formulating these prop- 
erties, 

1°. Additivity. If a function 7 (x, y) is integrable in a domain D 
and if a curve F of zero area divides the domain D into two connected 
domains ), and D, having no interior points in common, then 
7 (x, y) is integrable in either of the domains D, and D,, with 


( \f (z, y)drdy = 4 f(x, y)dxdy +- \ J re a) az dy 
es) ‘Dy D3 


2°, Lincar property. If functions f (2, y) and g (z, y) are integrable 
in a domain D and @ and £ are any real numbers, then 
la-f(r, y) ++ Beg (x, y)l is also integrable in D, with 


\\ taf lr +B R(t, Whdzdy= 
“Dp 


=a yi f{z, ¥) dr du +B \ &(z, ¥) dr dy. 


3°. If functions f (z, y) and g (z, y) are integrable in a domain D, 
then so is their product, : 
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4°. If f (cz, y) and g (x, y) are both integrable in a domain D and 
everywhere in D we have f (z,"y) < g (z, y), then 


\Ji@ ydvay < Sf ele, wdeay. 
D D 


5°. If f (x, y) is integrable in D, then so is | f (z, y) |, with 
|| fre, wacdy|<J fife, Widedy. 
D DB 


(Of course, the integrability of | f (x, y) | in D does not imply that 
of f(z, y) in D.) 

6°. Mean value theorem. If both functions f (7, y) and g (z, y) are 
integrable in a domain D, the function g (z, y) is nonnegative (non- 
positive) everywhere in D, and M and m are the supremum and in- 
fimum of f (x, y) in D, then we can find a number yp: satisfying m < 
<< M and such that we have the formula 


J) fe We wdedy=p J | e(e, y)dedy, (2.44) 
D D 


In particular, if f (x, y) is continuous in D and D is bound, then 
we can find in D* a point (€, n) such that p = f (E, n) and formula 
(2.11) becomes 


Jie, wee, vydcay=se, wl ee, wardy. 
D D 


7°. Important geometrical property. i 1-dz dy is equal to the 
D 


area of a domain D. (As was already noted above, this property 
follows immediately from the definition of integrability in Section 
2.1.3.) 


2.3. REDUCING A DOUBLE INTEGRAL TO AN ITERATED 
SINGLE INTEGRAL 


Reduction of a double integral to an iterated single integral to be 
discussed in this section is one of the efficient ways of computing 
a double integral. 

2.3.1. The case of the rectangle. 


Theorem 2.6. Let there be a double integral J ( f (x, y) dx dy for 


R 
a function f (x, y) in a rectangle R = la<z<bj xX lex y<d). 


* By Theorem 414.5 of [4]. 
5—01684 
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Also let there be for each x of the closed intervala <2 < ba single 
integral 


I(z)= \ ft, y) ay. (2.12) 


O fm, OL, 


T. — there is an ee integral 
o 


T (x) dz= { dr f(z, y)du (2.13) 


ry 
a c 


and we have 


dx \ f(z, y) dy. 


0 mena 


| f(z, u)drdu= 
oe 


Ooms 


Proof. As in Section 2.4, divide the rectangle R by means of the 
points amar... <a, = db and c= yKy< 
<Ys <2... <p = d into n-p subrectangles 

Rayr= [rar STS] X (Yer SYS) 

Ay. Dic MEN 2 sates 
Set Ax, = 2p — Tee, AY = Yr — Yr-y and denote by AY and mt 
the supremum and infimum of f (z, y) on a subrectangle J2,). Every- 
where on #2), then 

MS / (7, nS Mi (2.14) 

Set x = &,, where &, is an arbitrary point in a closed interval 
(zr, 1, tJ, and after that integrate (2.14) for y going from y)_, to y). 
We eet 

vy 
mp Ain < | fn vy) dy< My Am. (2.45) 
Vin} 

Summing (2.15) over all 7 from 4 to p and using notation (2.12) 

we have 


P 
> Mp Aus] (Ex) 3 Mie Aye (2.16) 
ist 
Next we multiply ree ie Az, and sum over aj] i from 1 to n. 
We get 


n 2 1: 
oy Ba, myAz),Amy < 2s YE) Az, < ees NS Myp- Ax, Am 
he lea Urn we 


(2.17) 
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Let the greatest diameter A of subrectangles tend to zero. Ther 
so does the greatest of the lengths Az,. The framing terms in (2.17), 
the lower and the upper sum, then converge to a double integral 


ff Gy ae ay. 
There is therefore a limit on the middle term too in (2.17), equal 


to the same double integral. But that limit by the definition of the 
single integral equals 


b b d 
[2@)de= {ae \ fee, y) ay. 


This proves the existence of the iterated integral and equation (2.13), 
Thus the theorem is proved. 

Remark. In Theorem 2.6 we may interchange z and y, i.e. we may 
assume the existence of the double integral and the existence for 
any y in the closed interval c< y < d of the single integral 

b 
K(y)=) fe, ae. 


a 
Then the theorem will state the existence of the iterated integra] 
d d b 
| Kmay= J ay lite, wae 
c a 


c 


and the equation 


\ f(z, y)dzdy= j dy ‘ f (x, y) dz. (2.18) 


R c 


2.3.2. The case of an arbitrary domain. 

Theorem 2.7. Let the following conditions hold: (1) a domain D is 
bounded, closed and such that any straight line parallel to the Oy axis 
intersects the boundary of that domain in at most two points whose 
ordinates are y, (x) and yy (x), where y, (t) < Yo (x) (Fig. 2.4); (2) the 
function f (x, y) allows the existence of a double integral 


{| f@ Waray 
D 


and the existence for any x of a single integral 
¥a(x) 
f(z, y) dy. 
u(x) 
5% 
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Under these conditions there is an iterated integral 
*3 ye(x) 


\ dx \ f(x, uydy 


4 u(x) 


(x, and x, being the smallest and largest abscissas of the points of ?) 
and we have 


Xs ve(x) 
[ (1, ydrdy = [ae | f(z, dy. (2.19) 
“Dp 1 myx) 


Proof. Denote by 2 a rectangle with sides parallel to the coordi- 
nate axes and containing a domain D, and by F (z, y) a function coin- 
ciding with f (z, y) at the points of D and equal to zero at the other 





(y) m3(y) = 





Fig. 2.5 


points of R. For the function / (z, y) all hypotheses of Theorem 2.7 
hold in #2, and therefore we have formula (2.13) which (considering 
that F (x, y) is zero outside D and coincides with f (7, y) in D) goes 
over into (2.19). The theorem is proved. 

Remark {. In Theorem 2.7 we may interchange z and y, i.e. we 
may assume that the following two conditions hold: (4) the domain 
D is such that any straight line parallel to the z axis intersects the 
boundary of the domain D in at most two points whose abscissas aro 
x, (uw) and xy (y), where 2, (y) < tq (y) (Fig. 2.5): (2) f (2, y) allows 
the existence over D of a double integra] and the existence for any y 
of a single integral 

X2(¥) 

\ f(z. u) dr. 

ay) 

Tf the two conditions hold there is an iterated integral 
vs Xa(y) 


Jay \ f(z vax 


a iy) 
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(y,; and wy being the smallest and largest ordinates of the points of D) 
and 


ve xg(t) 
\ { T(z, v)drdy = \ dy \ f(r, y) dz. (2.19') 
tr Ax”) 


Example. Let a demain D be the circle 22 -- y° < R? (Pig. 2.6) 
and f (x, y) = 27 (RP = yf). Any straight line parallel to the x 


yA 





Fig. 2.6 Vig. 2.7 


axis intersects the boundary of D in at nt {wo points whose abscis- 
sas are z, = — VRE ~ y* and 2, = VRE Y (seo Fig. 2.6). 
Therefore, applying formula (2.19’) we get 


Vv Mee 
(l(a, y) dxdy = dy x (Ri— yy? dr= 
@ - pe 
A Vie ‘ " 
={ (Re— yy? [ { Foal dx | dy == { (R?— y%)3 dy = 3 RV, 
=O Vie ch 


Remark 2. In caso a domain D fails to satisfy the requirements of 
Theorem 2.7 or Remark 4 to it, it is often possible to divide that 
domain into a sum of a finite number of domains of this type that 
have no interior points in common. Then the integral over D is, by 
additivity (see property 41° of Section 2.2), equal to the sum of tho 
integrals over the corresponding domains. Thus it is possible to divide 
the domain D depicted in Fig. 2.7 into the sum of three domains, 
D,, Da, and Ds, to each of which we can apply either Theorem 2.7 
or Romark 1. 
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2.4, TRIPLE INTEGRALS AND 1-FOLD MULTIPLE INTEGRALS 


The theory of double integral we have presented can be extended, 
Without introducing any new ideas or complications, to the case of 
the triple integral or 10 n-jold multiple integral in general. We shall 
discuss the main points of the theory of n-fold multiple integral. 

First of all. let us define the volume of an n-dimensional rectan- 
gular parallelepiped to he equal to the product of the lengths of all 
of its edges emanating from a single vertex. 

Let us further give the name of an elementary body to a set of 
points of an n-dimensional space that is a sum of a finite number of 
n-dimensional rectangular parallelepipeds without common interior 
points and with edges parallel to the coordinate axes. 

The volume of any elementary body is known to us and is equal 
to the sum of the volumes of the constituent parallelepipeds, 

Now let PD be a bounded domain in n-dimensional Euclidean space. 
The lower volume of D is the supremum V of the volumes of all 


elementary bodies contained in D, and the upper volume of D is the 
infimum V of all elementary bodies containing 7. 

It can easily be seen that V < P*. 

A domain D is said to be cubable if ¥ = V. The number V = 


= |= V is the n-dimensional volume of D., 


The following statement can be proved in complete analogy with 
the case of the plane domain. 

For an n-dimensional domain to be cubable, it is necessary and suf- 
ficient that for any positive number e¢ there should be two elementary 
bodies, one containing D and the other contained in 1), the difference 
between whose volumes in absolute value is less than et. 

Let us agree to apply the term surface (or manifold) of n-dimensional 
volume cero to a closed set all the points of which lie in an elementary 
hody of arbitrarily small 2-dimensional volume. 

It is obvious that an x-dimenstonal domain D is cubable if and 
only if the boundary of the domain is a manifold of n-dimensional 
volume zero, 

First an n-fold multiple integral of a function of nm variables 
f (1, 72. . - «5 %,,) is defined in an n-dimensional rectangular paralle- 
lepiped 72 whose edges are parallel to the coordinate axes. 

To this end we divide each of x edges of 2? into a finite number of 
seginents to obtain a subdivision 7 of #? into a finite number of 
n-dimensional subparalelepipeds**, 





* The inequality V < ¥ can be proved in exactly the same way as P< F 
was in Section 11.2.1 of (11. 

*° It may be said that a subdivision 7 is carried out hy incans of a finite 
number of (n — 1)-dimensional hyperplanes parallel to the coordinate axes, 
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For the subdivision 7 the integral, upper, and lower sums of any 
bounded function f (z,, Z, . . ., Z,) are defined in complete analogy 
with the case n = 2, 

The n-fold multiple integral of f (z,, £2, . . ., Z,) over the paralle- 
lepiped FR is defined to be the limit of integral sums as the length of 
the largest of the diagonals of the n-dimensional subparallelepipeds 
tends to zero. 

As for the case 2 = 2, Darboux’s theory establishes a necessary 
and sufficient condition of integrability in the following form: for a 
function f to be integrable in a parallelepiped R it is necessary and 
sufficient that given any 2 > 0 there should be a subdivision T of R for 
which the difference between the upper and the lower sum should be less 
than e. 

After that it is easy to define the n-fold multiple integral of f 
over an arbitrary closed bounded n-dimensional domain D with 
boundary of n-dimensional volume zero. 

This integral can be defined as an integral over 1 D-containing 
n-dimensional rectangular parallelepiped R (with edges parallel to 
the coordinate axes) of a function F coinciding with f in D and zero 
outside D. 

It is natural to designate an n-fold multiple integral of a function 
f (2, a, ..., Z,) over a domain D by the symbol 


SJ ties fie, Loy vvey Lp) AL, Oy 00 Aq. (2.20) 
D 


To abbreviate notation where no confusion may arise, however, we 
shall denote the integral (2.20) briefly 


f #(2) ae. (2.20’) 
D 


In (2.20’), by 2 we mean a point t = (a, %2,..., %,) in EL”, by 
dz a product dz = dz, dz... dz,* and by \ an n-fold multiple 
D 


integral over an n-dimensional domain D. 

Just as for the case » = 2, we can prove integrability over an 
n-dimensional domain D of any function f possessing inD the /-prop- 
erty (i.e. a D-bounded function all of whose discontinuit« points lie 
in an elementary body of arbitrarily small n-dimensional volume). 
In general no change in an integrable function f ona set of points of 
n-dimensional volume zero would change the value of the integral 
of that function. 

To define the n-fold multiple integral we can use division of a 
domain D into a finite number of subdomains of arbitrary form by 


* This product is usually called an element of volume in E%. 
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means of a finite number of arbitrary manifolds of volume zero, 
Repeating the arguments for Theorem 2.5 we prove that such a gen- 
eral definition of the n-fold multiple integra) is equivalent to the 
above definition. 

In complete analogy with Theorem 2.6 and Theorem 2.7 we estab- 
lish the iterated integration formula for the integral (2.20). 

Let an n-dimensional domain D,, possess the property that any straight 
line parallel to the azis Ox, intersects its boundary at at most two points 
whose projections onto the axis Ox, are 


WNBag oy so 45 Bq) ANE O (Bay Bey sw ay Be), 


WHEE (Baye Bay et ty Ba) Se Bag Vay ce wong Bale 
Further let the function f (xy, Zo, » «+, Xn) allow the existence of an 
n-fold multiple integral 


\ ( hake f fen Bay as 04 Splat Oboes Oke 
“ Dy, 
and the existence for any Zo, Zq, .. ., Zp Of @ single integral 
Ura. z3 oe 02 q) 


F(X q_ Loy ovey Lyn) Ay. 


e 
C(Xq. X26 XQ) 


Then there is an (n — 1)-fold multiple integral 


(X%g. X3, 22 oe xy) 


i state | az, das... dz, J FAG Gy ne dg En) Oz, 


Dy. O(Xg. X3, 666 X_) 


over an (n — 1)-dimensional domain Dy. which is a projection of Dy, 
onto the coordinate hyperplane Orerg, . . »5 Tp, and we have the iterated 
integration formula 


\ ( as (fle Lay oe ekn) dr, dr. ... At z= 
D, 
U(xa, x3, vere ®y) 


={{ san | az, dy... dz, j PCa Sap Seg Se) a 


. 


Dy, O(Xg, TB. ose Xp) 


(2.21) 

Of course, in the statement above any of the variables z., 2, ... 
«++; 2, may also play tho part of 2. 

We shall agree to say that a domain D is simple if every straight 
line parallel to any coordinate axis either intersects the boundary of 
the domain in at most two points or has an entire segment on that 
boundary. 
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Given a simple domain we can use ne iterated integration for- 
mula for any of the variables x,, Ze, . 

An n-dimensional rectangular siarallelentied (whose edges are 
not necessarily parallel to the coordinate axes) may exemplify a 
simple domain. 

In conclusion we note that properties 1° to 7° formulated in Sec- 
tion 2.2 for the case of the double integral remain valid for the 
n-fold multiple integral. 


In particular ae 7 {-dz, dz, ...dz, is equal to the n-di- 


D_ 
mensional volume V (D) of a domain D. 
In addition, as for the case n = 2, the following statement holds. 
Let f (ty, La). . ., Zy) be a function integrable over a bounded cubable 
domain D. Also let E™ be a space covered by a net of n-dimensional 
cubes with edge h; let Cy, Co, + Cuny be those cubes of the net that 
are contained entirely in D; let (EQ, ECA), , &)) be an arbitrary 
point of a cube pets and let m, be the ‘infi mum of f in a cube 
C;, (k = 1, 2,..., 2 (h)). Then the sums 


n(n) " nth) 
A F(R, EM), 2, EM) nt and py m,-h” 


have a limit, ash 0, equal to j j ox J f (®, Lay - 09 Bp) de, X 
D 
Pa: PR fe 


2.5. CHANGE OF VARIABLES IN AN n-FOLD MULTIPLE INTEGRAL 


The purpose of the present section is to justify the formula for 
change of variables in an n-fold multiple integral. 

The formula to be established is one of the major tools for com- 
puting an n-fold multiple integral. 

Suppose that a function f (y,, Yo, « «+» Yn) allows the existence of 
the n-fold multiple integra] 


| faay= Jf vee J #Wp Yor oer Yn) AYy Yo «++ Gyn (2.22) 
D D 


over some bounded closed cubable domain D in the space of variables 
Yi> Yoo « « +» Yn» Further suppose that we change from y1, Yor +» +1 Yn 
to some new variables 2,, 22, .. ., Zn, i.e. make a transformation 


Ys = Py (Ly, Loy oe ey Ln) 


Yo= Po (£4, Za, +0, Lp) (2.23) 


ee eeeee et ee ee @ 


Yn = Wr (Tq) Lay oo ey Lp). 
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In shorthand, (2.23) wil] be denoted by the symbol 
y = 1p (z), 


where xz and y are points of the n-dimensional space z= 
at (yy Tay oe oy Tn) ME (ys Yond e+ 0 Un) and tf is the collection of x 
functions tPy, fa... -, Wre 

We denote by D’ the domain in the space of x1, z., . . ., @, trans- 
forming under (2.23) to D, i.e. set D = p(D’)*, 

We prove that if the functions (2.23) have continuous partial 
derivatives of the first order in D’ and if the Jacobian 





~" {u) __ z (ys Yop oes Yn) (2 24) 
& (x) 5 (Lyy Toy -00y Tn) 7 


ig nonzero in D‘, then for the integral (2.22) the following change of 
variables formula is true: 


Jim) ay= | sr (=i JA aw 


dD 


dz. (2.25) 





In explicit notation (2.25) has the form 


\| ce a | fen Yor eve Yn) dy, Ys 85%, dy, = 


D 
. 1 ie Vitti, wees Zn)y coer Wn (Ly 00, La) X% 
ee et 
@Ury eee Un) 


a ce 
a dz, ... dXy. (2.25) 





Thus we shall prove the following main theorem. 

Theorem 2.8. If the transformation (2.23) converts the domain D’ 
into D and is one-to-one and if the functions (2.23) have in D' con- 
finuous partial derivatives of the first order and the nonzero Jacobian 
(2.24)**, then provided the integral (2.22) erists (2.25’) is true. 

The proof of Theorem 2.8 is not elementary. The basic idea behind 
it is that we first justify formula (2.25) for the case where the trans- 
formation (2.23) is linear and then reduce the general transformation 
(2.23) to that case. 

For convenience we divide the proof into several steps. 

Proof of Theorem 2.8. 

1°. Lemma 1. If a transformation z=. (zx) is a superposition 


= Dy assume that the transformation (2.23) has the inverse and that D’ = 

"* Note that when the hypotheses of Theorem 2.8 hold equations (2.23) 
can be solved for =z, ts, ..., Zn, the inverse transformation x=1-? (vy) 
obtained in this way having in D, by Theorem 14.2 of {(4],_ continuous 
(x) 


partial derivatives of the first order and a nonzero Jacobian zm’ 
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(or, as it is usually called, a product) of two transformations y= 
=, (x) and z=, (y), then the Jacobian aa taken at any point 


o 0 a 0 
- . F D (y) @D (2) 
Z=(2y, Lo, ---, Lp) is the product of the Jacobians BG) and ZW 


0 oO oO 0 
taken respectively at x= (a4, Lo, ..., Tn) ANA Y=(Yq, Yo) «+1 Yn)ds 
0 


where y= p(x), i.e. 


2) _ De), Zw) (2.26) 


Di (24) 205 «+29 Zn) ee D (zy, Za) «+«y Zn) D Yr» Yor --++ Yn) (2.26') 


eee 


Proof of Lemma {. The element at the intersection of the ith 


row and the Ath column of the Jacobian ae is equal to oe 


Oxp? 
with the partial derivative taken at a point x. By the indirect 
differentiation rule (see Section 14.7 of [1]) 





Tn 
Oz, dz, OY 
an = 2 ene (2.27) 
all partial derivatives 5H on the right of (2.27) are taken at 
0 : c 0 
x and all partial derivatives Fe at the corresponding points y= 


0 


1 (Z). 
Equations (2.27), true foranyi = 1,2,...,nandé = 1,2,...,n, 
and the theorem on the determinant of a product of two matrices 
(see “Linear Algebra”) lead directly to formula (2.26). 

The proof of Lemma 1 is complete. 

2°. Before stating the next lemma we recall the definition of linear 
iransformation of coordinates. 
Linear transformation is a transformation of the form 


Ys = Oy yXy + DynZo + ooo + Ain Tny 
Yo = AgyXy + Aga oe + A2nZp, (2.28) 


ey 


Yn = OnLy + Ano + -6. + AnnXn, 


where aj, (i = 1, 2,..., 7; k = 1, 2,..., ”) are arbitrary constant 
numbers. 
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The linear transformation (2.28) will be briefly denoted by y = Tz, 
where x and y are points x = (Z,, Fe, 2... Bm) and y= 
== (Uy. Mey. ees Mp) Of a space E” and 7' is a matrix T = flay, !! 
(Pee 1 2a bee te 2s ecu na) 

The matrix 7 is usually called the matrix of linear transformation. 

If the determinant of the matrix of linear transformation det 7 
is nonzero, then y == Tris said to be a nonsingular linear transfor- 
mation. For such a cransformation, by the Cramer theorem*, we can 
solve equations (2.28) for z1, 2a, .~.-, %, and assert the existence of 
the inverse transformation z = 77y which is also linear and non- 
singular. 

Further notice that for the linear transformation (2.28) the 
Co 
Fh coincides with the determinant of the matrix 7 
of the transformation, i. e. 

¢, 

ZY) det 7. (2.29) 


of (xz) 


Jacobian 


The main purpose of this and the next two subsections is to prove 
that the change of variable formula (2.25) is valid for an arbitrary 
linear nonsingular transformation (2.28). In view of relation (2.29) 
it suffices to prove that for any linear nonsingular transformation 
y = Tx we have the formula 


lfw)dy= | f(P2)Idet Plax (2.30) 

D T71D 
(provided there is an integral on the left of the formula). 

In the present subsection we shall prove that (2.30) holds for two 
special types of linear transformations: (1) linear transformation 7? 
consisting in multiplying the ith coordinate by a real number 7. = 0, 
with the other coordinates remaining unchanged**, and (2) linear 
transformation 7',, consisting in adding to the ith coordinate the jth 
coordinate, all the other coordinates except the ith coordinate 
remaining unchanged***, 

Lemma 2. If f (u) is integrable in D, then (2.30) holds for either of 
the transformations 1 and 1'j3. 

Proof of Lemma 2. Denote by # an n-dimensional rectangular 
parallelepiped containing D and by F a function equal to f inD 
and to zero in R — D. It suffices to prove that for either of the 


—~ 


* See “Linear Algebra” for the Cramer theorem, 
** In symbols 
(x45 Tae oo og Zn) basic (z;. ee ee Thay hry, Tltiy «0 ey In)+ 
e@ In symbols 
(Zp Tay ee or Ty) Oh (Tae oo oe Zpony FEF Zp, Tppty e+ oy Tn) 
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transformations 7* and 7,; we have the formula 
{ Fu)dy= | F(Px)-|det PIdr, (2.34) 
R T*1R 
in which T denotes one of the transformations, Ti or 7,;. 
An elementary calculation shows that 
detT?=, det T,,=1. (2.32) 
Moreover, it is obvious that if R is a rectangular parallelepiped 
ay < Yn S by (k= 1, 2, ..., n), then [7%] R is a rectangular 
parallelepiped 


a; <2, <b, whenk <i, 


bi (2.33) 
<2; vs 
and [7;,]-! R is a fortiori a cubable domain 
OQ, 2, <b, whenk =i 
{ hl, QO, ’ (2.34) 
Qj — %jQT, QO, — 2j. 
On the basis of the iterated integration formula (2.21) 
by by Otay by 
| Faay= | eee j j eee Gy eos Gp GY pay oes 
R a1 O34 yy ay 
b; 
soe Um | F (Wty vee Un) dye. (2.35) 
o% 


Applying to a single integral with respect to a variable y; the 
change of variable formula y; = Az; for the case of 7» and y; = 


= 2; + 2; for the case of Ti; (see Section 10.7 in [1]) we get: 
(a) 
by 
j F (yy eoes Yn) i= 
% 





, 
| j F (Y4y eees Yents NZty Ytrsr o++s Yn) (—A) dzy when <0; 
\ oy 


iJ 


(2.36) 


-> 
t 
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for the case of ft, and 
(b) 


Y 
\ FY. ees Yn) d= 


teas 
= \ Pty, caee Miety TEP Ty Vergy ves Yn) dz (2.37) 


nynxy 


for Ty. 

ening (2.36) into (2.35), applying once again formula (2.2{) 
and taking into account the equation y;, = 2), with & = i, the form 
(2.33) of 17%]-' R and the first of the equations (2.32) we obtain 
formula (2.31) for the case of 7}. 

Similarly, inserting (2.37) into (2.35), applying the iterated in- 
tegration formula and taking into account (he equations y, = 2}, 
with hk =: i, the form (2.34) of [7,;]-1 J? and the second of the equations 
(2.32) we obtain formula (2.34) for the case of 7;;. This completes the 
proof of Lemma 2. 

3°. Lemma 3. Any nonsingular linear transformation T can be re: 
presented as a superposition of a finite number of linear transformations 
of the types 7? and Ty}. 

Proof of Lemma 3. We first verify that the linear transformation 7" 
consisting in interchanging some two coordinates can be represented 
as a superposition of six transformations of the types 7* and 715. 
Indeed, let 7’ consist in interchanging the ith and jth coordinates 
(the other coordinates remaining unchanged). Then it is easy {o 
verify that*® 


Tl TEL TPT TET 15. (2.38) 


Now notice that by a finite number of interchanges of two rows 
and two columns a quite arbitrary linear nonsingular transformation 
7 can be reduced to a linear transformation (2.28) with matrix |] an. {I 
all of whose so-called principal minors are nonzero, i.e. all determi- 
nants 


Aig oe Ay 
hee eee Gr ee nem (2.39) 


Aq eee Any 


* Indeed, keeping in writing only the ith and jth coordinates we get, on 
performing the chain of transformations (2.38), (zy, 7j) — (2,4 2p 2) 
(rym ry ry) me (may zy Ty) (Ry yp ty) AH (Hy ty) > ep). 
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It remains to prove that the last linear transformation can be 
represented as a superposition of a finite number of transformations 
of the types 7} and T,;. 

We shall prove this by induction. 

Since A, = ay, 0, using [21 we obtain (2%, 2, .. +, Za) > 


—> (A374; Za, oe 09 Z,). : 
Now suppose that by superposing a finite number of transforma- 
tions of the types Tt and 7';; we have succeeded in reducing the origi- 


nal sequence of coordinates (21, 22, ..-, Z,) to the form 
(A ygly-P oe PO, Ty, oo MysTi-b oe. + OpnLhs Thtiy oer Tn). (2-40) 
To complete the induction it suffices to prove that by superposing 
a finite number of transformations of the types Hie and T;; we can 
reduce the sequence of coordinates (2.40) to the form 
(Qh pt oe HO nssyTegis coer Bysshe Pps Tn+ts 
Bip gaysty bt oe FO nasynsyenets Tate, «+ 0) Zn): 
First for every i for which the element aj(,43) is nonzero we per- 
form successively a pair of transformations TyniyT,i9) (for 


those i for which a)(;,4,;) = 0 the corresponding pair of transforma- 
tions is not performed). Superposition of all the pairs of transforma- 
tions reduces the sequence (2.40) to the form 


(Q4,%4-+ vee + Oynt1y Tatty ove, Bpyy + eee + 
+ On tiyTrtis Thtts Tate, «eer Tn) (2.42) 


Further notice that since the minor (2.39) is nonzero, so is the 
determinant 


(2.41) 


Dig coe Asn Ayenety 


Cr ee 


(2.43) 


Ont o++ Arn Arents) 

0... 0 1 
equal to it. 

But then there are real numbers A,, ..., Ax; Axzy such that a 
linear combination of the rows of (2.43) with those numbers is equal 
to* 


Crests coer Garth, Tntsnty- (2.44) 


This means that if for every j = 1, 2,..., & + 4 for which 
Ay 3 0 we perform successively a pair of transformations 7,43); ri 


* To prove this it suffices to add to the matrix of the determinant (2.43) 
the row (2.44) and to apply the theorem on the principal minor (see “Linear 
Algebra”). Me 
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(for those j for which 4, = 0 the corresponding pair of transforma- 
tions is not performed,) then superposition of all the pairs of trans- 
formations made converts the sequence (2.42) into (2.441). This com- 
pletes the induction and the proof of Lemma 3. 

4°. Lemma 4, For an arbitrary linear nonsingular transformation 
(2.28) the change of variables formula (2.30) holds, provided the integral 
on the left of (2.30) ezists. 

To prove Lemma 4 it suffices to notice that formula (2.30) holds 
for each of the transformations of the types 7* and 7,, (Lemma 2) 


and that an arbitrary linear nonsingular transformation (2.28) 
can be represented as superposition of a finite numbor of transforma- 
tions of the types 7? and 7;; (Lomma 3), superposition of linear 
transformations involving multiplication of the corresponding Jaco- 
hians (Lemma 1). 

Corollary of Lemma 4. If G is an arbitrary cubable domain in E", 
T is an arbitrary nonsingular linear transformation, then the n-dt- 
mensional volume V (G) of G and the n-dimensional volume V (TG) 
of the image TG of G are related by 


V (TG) = |det 7|-V (G). (2.45) 


To prove this it is enough to put in ¢ 30) fs=_1, D = 7G and 

lake into account the fact that T-“1D = 

4°. Now we proceed to justify the ais of variables formula 
(2.25) for a quite arbitrary transformation y = 1p (x) satisfying the 
hypotheses of Theorom 2.8. 

It should be emphasized that when the hypotheses of Theorem 2.8 
hold the integrals on the left and on tho right of (2.25) both exist, 
so that we are to prove only the equality of the integrals. 

Let us agree to denote by J1;(z) the elements of the Jacobi 
matrix a (i=1, 2,..., m3 f=4, 2,...,m) taken ata point z= 
== (2, ies eee Zn). 

The Jacobi ‘matrix itself, |] Jry (z) |] will be denoted by Jy (x). 

It is convenient to introduce the norm of a point x = (2, 2,.-- 
err *) and the norm of a matrix A = |l ayy || (i = 1, 2, 2. 0, M3 
foe dy 25.6 oye). 

The norm of a point x = (2,, ta, . «+, Zp) is @ number denoted 
by the symbol || x |landequal to max  |2; |. 


im] ' 2. eee 
The norm of a matrix A= [lazy || is a number denoted by the 
symbol || A|| and equal to eo iy Jaryl]- 


Notice that with such a dettaition of the norms of a point and of 
n matrix the equation y = Az implies that 


Wy <All Well (2.46) 
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In addition it is easy to verify that for the unit matrix E we have 
\ # || = 1. 

In this subsection we shall prove the following lemma. 

Lemma 5. If the hypotheses of Theorem 2.8 hold and if C is an n- 
dimensional cube in D', then the n-dimensional volumes of the cube C 
and of its image wp (C) are related by 


VOR) ss lmex ll (z) III" -V (€). (2.47) 


Proof. Let C be an n-dimensional cube with centre at a point 
0 a 


t= (Say Bay: Say Zn) and with edge 2s. Then the cube C can be 
defined by 


0 
jr—az ||<s. (2.48) 


By the Taylor formula for a function of » variables yp; (z) (see 
Section 14.5.3 in [4]) there is a number 6, in 0 < 6, <1 such that 


0 n 0 0 0 
be (2) — th: (2) = pa Ji3(2+8 (z—z)) (zy— 25). 


From this and from relation (2.46) we conclude that 

(2) — @) <<a UJ (2) 22h (2.49) 
Setting y = » (2), y =p (2), we get from (2.49) and (2.48) 
yy Il<s-max I Jo (2) I 


Thus when a point x is changed inside an n-dimensional cube C 
with edge 2s the image of x remains inside an n-dimensional cube whose 
edge is 25+ max || J» (z) ll. 

€C 


x! 

This leads at once to the cubability of the image tp (G) of any cub- 
able set G* (in particular, to the cubability of p (C)) and to inequal- 
ity (2.47). This completes the proof of Lemma 5. 

6°. Lemma 6. Let the hypotheses of Theorem 2.8 hold and let G 
be a cubable subset of D'. Then for an n-dimensional volume of the 


image wp (G) of G we have** 
Vip (@)< { jdet Jy (x) |dz. (2.50) 


G 


* Indeed, the boundary of any cubable set G is a set of n-dimensional volume 
zero, and such a set, by the statement proved, can be transformed into a set 
whose n-dimensional volume is also zero. 

** The fact itself of the cubability of sp (G) follows from the statement proved 
in the preceding lemma. 


6~01684 


~r 
? 
Ww 
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Proof of Lemma 6. We first prove that for any non-singular linear 
transformation 7 and for any n-dimensional cube C contained in D’ 


V (4 (C))<fdet 7] -[max |] TJ ¢ (x) IYJP-F (C). (2.51) 
x€C 


By the coro}lary of Lemma 4, for any cubable set G and for any 
linear transformation 77! 


V (771G) = [det 7-5]. (G). 
Thus if G@ = 1 (C), then* 

V (ap (C)) = | det 7 J-V (Lo-hp (C)). (2.52) 
We evaluate the right-hand side of (2.52) using (2.47) by taking 


(2.47) not for the transformation wp but for the superposition of 
transformations 7’. Then 


¥ OF (C)) < [aot 7} -(max HM ras (2) I"-¥ (C). (2.53) 


considering that the Jacobian matrix of a linear transformation 
coincides with the matrix of that transformation we gel by Lemma ! 


J pete (x) = TAS» (x). 


But this exactly means that inequality (2.53) may be rewri{ten 
as (2.51). 

This proves inequality (2.51). 

Now, to prove Lemma 6, we cover the space £” with a net of 
n-dimensional cubes with edge k, and let Cy, Ca, .. +5 Enea be 
those of the cubes that are contained entirely in G, and let G),, denote 
the sum of all the cubes. 

On choosing in every cube C; a point z; we write for that cube 
inequality (2.51) setting 7 = Jy (z,)). We get 


VOR(CD)< tdet Sy za] {max | Fo (edt Fe 2) V (En. 
xEG, 


Summing the last inequality over all i from 41 to n (hk) we get 
n{h) 


VF EMSS Met Fe (e)] Emax Fe (2) Se (2) IV (Ca). 
(2.54) 


Since the elements of the Jacobian matrix Jy (x) are continuous 
functions of a point x in the whole of D’ and all the more so in G 
and the product [Jy (z)}-!- Je (z) is a unit matrix whose norm is 
equal to unity, we have 


lim max {[ (J's (z) 17! Fe (2) [l= 4. 
haoO xéC, 


re : 
* We take into account the fact that 7-7-1 = EF, so that det T-det To! == 4. 
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But then it follows from the statement formulated at the end of 
Section 2.4 that the limit of the entire right-hand side of (2.54) 


as kh --0 exists and is j | det Jy (x) | dz. 


6 
That same statement implies that lim G, = G, so that in the 


h-0 
limit as kh +0 we obtain from (2.54) inequality (2.50). The proof 
of Lemma 6 is complete. 

7°. Lemma 7. Let the hypotheses of Theorem 2.8 all hold and sup- 
pose in addition that f (y) is nonnegative in D. Then the change of var- 
iables formula (2.25) is valid. oe 

Proof. Cover £” with a net of n-dimensional cubes with edges i! 
and let C,, Cy, ..., Cnn) be those of the cubes that are contained 
entirely in D. Further let G; = w-! (C;). Writing for every domain G;. 
jnequality (2.50) we have 


Vv (C)< | \det Jy (2) |dz. (2.55), 
Gy; 

Now let m; be the infimum of the function f (y) on a cube C; (or 
equivalently the infimum of f lp (x)] in G;). Multiplying both sides 
of (2.55) by m; and summing over all i from 4 to n (h) we have 

nh) n(h) 

YS mV (C)< Dm, J [det Jy (a) Ie. (2.56) 

i=t it G; 

By the statement at the end of Section 2.4. the left-hand side of 
(2.56) has a limit as kh +0 equal to { f (y) dy. Since the sum of all 


D : 
domains G; is contained in D'* and f is nonnegative, the right-hand 
side of (2.56) for any h > 0 does not exceed 


[ £19 @))-1det Jy (2) Ide. 


D’ 

Thus we obtain in the limit as +0 from (2.56) 

{ Foav<J Ftp @)1- [det Jy (a) Lae. (2.57) 
D Db 


In our arguments above we may interchange D and D’ and consid-, 
er g (x) = f {yp (z))-| det Jy (z) | in D’ instead of f (y) in D. Using 


nh) 
* In view of the fact that >) C; is contained in D, D’=1-1(D),. 
1 
G;=y" (€;). 


6* 


we 


84 Fundamentals of Mathematical Analysis 


Lemma 1 and tho theorem on the determinant of the product of 
two matrices we obtain an inequality that has an opposite sense 


(10 @1- det Sy @ldz< | f(y) dy. (2.55) 
Dp D 

From (2.57) and (2.58) wo obtain the change of variables formula 
(2.25). The proof of Lemma 7 is complete. 

8°. It remains for us to complete the proof of Theorem 2.8, i.o. 
to got rid of the additional requiromont on the nonnegativity of the 
function f (vy) imposed in Lomma 7, 

Let f (y) bo a quite arbitrary function integrable over D and let Mf 
be the supremum of [ f(y) | in D*. 

By Lemma 7 the change of variables formula (2.25) is valid for 
cither of the nonnegative functions f, (y) =: Af and f, (y) = M- 
— f(y). 

But then tho linearity of the intogral implies the validity of 
Jormula (2.25) for the differenco f, (y) — fe (vy) = f (y) too. Tho proof 
of Theorom 2.8 is complete. 

Remark 1. Undor tho hypothoses of Thoorom 2.8 wo may assume 
the Jacobian (2.24) to vanish on some set of points S of n-dimension- 
al volume zero in D’. Indeed, S lies inside an olomentary figure C 
of arbitrary small area, with by what was proved above 


( fdy= [ f (1p (z)}- [det Jy (x) [ dz. (2.59) 

t(D’ -C) D’-c 

Proceeding in formula (2.59) to the limit with rospoct to a soquenco 
of elomentary figures {C;,} whose n-dimensional volumo ¥ (C,) 
tends to zoro we see that (2.25) is valid also for the caso under con- 
sidoration. 

Remark 2. Since the integral 


F=[ |... [tana ... damm (2.60) 
D 


is equal to the n-dimonsional volume V (D) of D, it is natural to call 
dy, dy. ... dy, an element of volume in the Cartesian coordinate 
system Oyo... Yn, considered. 

Using tho transformations (2.23) wo transform from the Cartosian 
coordinates Ys, Yo, » ++) Yn tO some now, genorally curvilinoar, 
coordinates 2,, Za, ..., Za. Since under such a transformation 
(by (2.25)) the integral (2.60) becomes 

ec fn 
re f(... {| Ste tee ne ta} dx, dz, ... d&ny 


“(Th Tay voey In) 


* Recall that the integrability of f(y) in D implies the boundedness of f (y) 
in D and the existence of the infimum and supremum, 
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it is natural to call 


t= Wn Der score Un) 
= (Far Far s++1 FR) 


C2; 62> 60 BP, 


an element of volume in curvilinear coordinate system 2. Ze, ..- 
Sede grows 

Therefore the absolute value of the Jacobian is characterized by 
the “expansion” (or “shrinking”) of volume under the transformation 
from Cartesian coordinates u,, Ye, «+, Yn tO curvilinear coordinates 
Bi bat a wees 


Let us compute the element of volume in spherical and cylindrical 


coordinates. 
1°. For the spherical coordinates (in three-dimensional space) 


I 


rcos @sin 8, 
rsingsin@, (r>0, @<Se@<a, CS ¢ <2) 


tty 
i 


N 
™ 
8 
7) 
a0] 


the Jacobian hes the form 


cos¢sin8 —rsingsin® rcos¢cos8 
< {=, ¥, 5) 
ln +2 2 te = ° —— ey 
fae o singsin@ rcosq@sin®8 rsin ocos@/—rsin 8. 
cos6 0 ~—rsin 6 


Therefore the element of volume equals r sin @ dr G8 eo. 
2°. For the cylindrical coordinates (in three-space) 


T cose, 
y=rsineg, (20, 0<¢< 2x) 


—_— 
xz 


the Jacobian has the form 


cosgo —rsing 0 


ee Et =|sing rcos@ O|=r. 
: 0 0 fi 


Therefore the volume element is r ar dp as. 
In particular, for polar coordinates in the plane the element of 


area is r cr é¢. 
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3°. In an n-dimensional space spherical coordinates are defined 
by the equations* 


z,;=rsin@,sin0.... sin0,-;, 
n~i 
Im =F 60S Om-; J] sin0, when m=2, 3, ...,2—4, 
heom 
In =r cosOn-4, 
where the spherical radius r and the spherical angles 0,, Oo, . «+: On-s 
vary over the range r>0, 0<6,<2n, OO, Sa for m= 
= 2,3,...,"—1. 
We can see that in this case the Jacobian has the form 
n=1 


Ei (X45 Tay ve es Tn) ptt I sin’! 0 
f(r, Oy eer On-y) } a . 


Thus the volume cloment in n-dimensional spherical coordinates is 
° n-1 


rt! dr {] sin #1! 0, d0,. 


em 

Example 1. Find the volume of a body bounded by the surface 

(x? + y? + 2°)? = az, (2.64) 
where a > 0. 

The body is symmetrical with respect to the coordinate planes 
Oyz and Ozz and lies above the plane Ozy. It is sufficient therefore 
to find the volume of the quarter of the body lying in the first octant. 

Transforming to spherical coordinates wo reduce equation (2.6!) 
to the form 

r=a a cos 0. 


Since in the first octant we have 
at Pad 
o<o< 4, 0<e<s, , 


in view of the expression for the volume element in spherical coor- 
dinates the desired volume V is 


n/t a2 a y’ 608 0 
Yo4 \ dg \ d0 ( resinOdr. 
tt 0 6 
ios ieee 


* The reverse formulas expressing n-dimensional spherical coordinates In 
terms of Cartesian ones are of the form 





| eRe ar * aa Z ms 
paz Porf eee Th sin Om = ’ cos Oy) = ’ 
Pros Timey 


peeueiene ners 
aybere tm 7 Voie ae re 2 oh 
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Thus 
- m/2 
ct 7 
Vx Bas { sin @cos0d0= 2, 
0 


Example 2. Find the area of a figure bounded by the curve 


zt y? zr v 
SteeETts (2.62) 


(where kh >0, k >0, a>0, b>0). 
To find this area if is convenient io transform to the so-called 
generalized polar coordinates 


Z= ar cos (, 
\ y=odrsing 
Equation (2.62) takes the form 


(O<<2n). 


r => cos (p ++ +2 sin p. (2.63) 
Since the left-hand side of (2.63) is nonnegative one should take only 
those values of p for which the right-hand side of (2.63) is nonnega- 
tive. 

On Eee and dividing the right-hand side of (2.63) by 


a= +e and determining gg from the relations 


‘ bik 
SIN Pg ay eh COS [o a=—k 
Vote V ete 


we reduce sad to the form 


ra V/ 24% sin (+0). (2.63') 


From the nonnegativity condition of the right-hand side of (2.63’) 
we find that O< go + <a, io. —M QVPQra— H.° 
Considering that the Jacobian ae 8 equals abr, we obtain for 


the desired area S the following expression: 
3. b2 


S= { dp { abr dr = 
-e 0 





A~o ae cots 
Zl 4) i sin? (p+ %) dp= ca ~ (fet+qr)- 
2A s* ie 


—~%0 
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We remark in conclusion that in computing a series of areas it is 
convenient to use a somewhat more general form of generalized 
polar coordinates 


Z=arcos® q, 
y = br sin® ~, 


It is easy to see that for these coordinates 
A(z, v) 


~ == aabr cost-! @m sin®-!p. 
Zr, 9) ? P 


SUPPLEMENT 


ON THE APPROXIMATE CALCULATION OF 7-Fold 
MULTIPLE INTEGRALS 


We shall discuss the question of approximating the n-fold multiple integra} 


{ \ os (fee, Sey soup En) G2 dey vos CEn (2.64) 
Gy, 

oper some domain G, of E", assuming first this domain to be an n-dimensional 

cube. 

Supposing the integral (2.64) exists we consider the question of optimal 
ways of numerical integration. 

The question has two aspects: (1) constructing numerical integration for- 
mulas optimal for given classes of functions; (2) constructing numerical integration 
formulas optimal for each pte function of a given class, 

Let us consider cach of these aspects separately. 

28.4. Formulas for numerical integration that are optimal for classes of 
functions. Let G, be a unit n-dimensional cube 0 <x, <1, k = 1, 2,..., 0. 

We shall say that f (z,, . . .) Z;) belongsin G,, to the class D& (Af) (respectively 
to the class 7% (4f)) if, provided all the derivatives appearing below exist, we 


have the inequalities 
aby 


erga <M, 
oe n 
Oxy) ... Oz, 








n 
B= Yia,p<en, a,<an 


est 


(respectively a), < a). : 
We shall use the term eubature formula for an expression of the form 


° 


* 


ere fren vee En) d2q oe dzn = ly (NERw (In (2.65) 


n 
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where 


N 
In(f) = SY Caf ei, ..., 2). 
k=1 


The points (c), . .., 24) will be called nodes and the numbers C;, are the 
weights of a given cubature formula, Ry (f, 2x) being its error. 

Our aim is to construct cubature formulas with error estimation accurate in 
order with respect to an infinitesimal 1/N, where NV is the number of nodes in the 
cubature formula. 

N.S. Bakhvalov showed* that neither for classes D& (Af) nor for classes 
H% (M) one can construct a cubature formula (2.65) with error estimation 
Ry (f, ly) better than C (a, n)-M-N~%, where C (a, n) is some constant depend- 
ing on @ and n. 

For classes H% (M) the indicated estimation is obtained (in order with respect 
to 4/N) if we take as ly the product of one-dimensional quadrature formulas. 
accurate for algebraic polynomials of degree an — 1. f . 

Assuming that the number of nodes N is N = m™, where m is an integer, we 
may put 


™ 
ly= 3} 


m 
Oye cee Oy F(Cyyr -209 Zp - (2.68) 
hy ws ? nm : " 


4 


where (zp, Cry}, Vv = 1, 2, «--, m2, are the nodes and weights of a one-dimen- 
sional quadrature formula accurate for algebraic polynomials**. _ 

For the error of the cubature formula with ly defined by equation (2.66) 
we have an asymptotic estimation (i.e., an estimation correct for sufficiently large 
values of WV) 

Ci (a, n) M 
Ry (fh ly) x SIN (2.67) 


where C, (a, n) is some constant depending on @ and r. 

For classes H& (M) there is also a cubature formula close in order of magnitude 
of error to an optimal one. Such a formula is the number-theoretic formula of 
N.M. Korobov***, 


N 
tv = $B fee (BE) me (SEG) (4), 
(2.68) 


where a;,..-, @ are integers, the so-called optimal coefficients modulo N, and 
>, (x) are some special polynomials of degree a -{ 4. For the error of the cubature 
formula with 1, defined by equation (2.68) we have 


[Rwy I < 2S bw (2.69) 


* N.S. Bakhvalov. On approximating multiple integrals. Vestnik MGU, 
seria matematiki, fiziki, astronomii, No. 4 (1959), pp. 3-18. 

** Such are, for example, the so-called Gauss formula or the Newton-Cotes 
formula (see, for example, “Methods of Computation” by 1.S. Beryozin and 
N.P Zhidkov). : : 

*** N.M. Korobov. Number-theoretic methods in approximate analysis. 
Moscow, Fizmatgiz, 1963. 


an Fundamentals of Mathematical Anatusts 


(C. (a, ny and § are constants depending only en @ and n). The estimation (2.65 
difiers from the estimation best in order only by the multiplier In&y, 

Thus there are sufficiently good cubature formulas for each of theclass 
DE (My) and HSM). 

Of course, in practical applications of these formulas one should consider 
their advantages and drawbacks emerging in particular situations. Thne it 
should be remembered that in computing integrals with the aid of fermuh 
(2.66) the number of nodes NV is not arbitrary but is equal to m™, For examp), 
for n:= 10 and the function f (2, .... 22) behaving roughly “equally” in all 
directions a reasonable number of nades will be N == 2! = 1024. When a grater 
accuracy is desirable, one can take the number of nodes equal to Ny = 3% = 
> ei but this will result in an almost 60-fold increase in compmntational 
wark. 

It should also be taken into account that for a “small” or “intermediate” 
number of nodes N the error of a cubature formula obtained using (2.66) may 
greatly differ from the right-hand side of (2.67)*. 

On the other hand. it is more advantageous to use formula (2.66) when com- 
puting large series of integrals or integrals of functions containing expressions 
depending on a smaller number of variables than n. 

Cubature formulas obtained using (2.68) are free of the disadvantage relating 
to the choice of the number of nodes N. It is appropriate to use these formulas 
for insufficiently smooth functions f and for a Jarge value of the number of 
variables n (beginning with n = £0). It should be noted, however, that for the 
error of a cubature formula obtained using (2.68) one cannot point out a prin- 
cipal term similar to the one on the right-hand side of (2.67). This makes difficult 
hoth estimating errors in making computations and predicting the number of 
nodes N required for a piven accuracy to be obtained. 

28.2. On formulas for numerical integration optimal for every particular 
function. We note at the outset that the matter is involved and that little 
detailed work has been done on it. 

To begin with, we revise the statement of the question under study. Suppose 
that a given function f (7), 75, . . .. t,) belongs to some class A,, and that we 
are given a set of methods of numerical integration {y).} of Chat function /. 
We shall seek in the given set a numerical integration method Py such that Ite 
error Ry (/, ph) is the infimum of errars Ry (f, py) of the set {py} of the given 
function f. 

In other words, we are seeking the best cubature formula for a given par- 
ticular function /, not for the whole class 4, to which (hat function belongs**. 

Take as a class A, a set of functions infinitely differentiable everywhere in 
an entire cube G,, except possibly some strface § of dimension & < non which 
those functions may go into infinity as {/rZ,, where Txy ig the distance hetween 
a point r= (aq, ..., 2,) and a point on the surface y = (yy, oy Wy) and 
yank — 1. 

The set {py} is defined as follows, 

For every cubature formula a,, exact for algebraic polynomials of degree 
m — 1 we define an element py of {py} as a cubature formula obtained hy 


* ‘Thus when using for (2.66) the Newton-Cotes quadrature formula the;right- 
hand side of (2.67) is clase to its left-hand side beginning with N == (a,,)" (for 
instance, for @ = 1 and n == 10, beginning with V == 10"), while when the 
Ganss farmnla is used for (2.66) the right-hand sid of (2.67) is close to the left- 
hand side beginning with NV == (an/2)" (i.e. beginning with Nw 107 for a -= 4 
and a -: 10). Thus in constructing cubature formulas with Jy defined by (2.60) 
the Gauss formula is preferred to the Newton-Cotes formula. 

*¢ A formula best fora class of functions is roughly speaking best for the 
“worst” funetion of that class, 
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dividing the entire cube G,, into rectangular parallelepipeds and using for every 
such parallelepiped a formula a,, with the proviso that the total number of nodes 
in the entire cube G, should be N. 

It 3s natural to expect the nodes of the cubature formula obtained in this 
way to be optimally allocated provided the error for each parallelepiped is 
constant. 

At the computing centre of Moscow State University routines were compiled 
for computing double and triple integrals that realized automatic subdivision 
of domains of integration. They were based on a pair of cubature formulas g,, 
and on, for m, > m. 


The number p = | 0, — Om, | was taken as the error estimation of a for- 


mula Gp). 

If e is a given computational accuracy, then when p < e (for an entire cube 
G,) We take as an approximate value of the integral the one defined by the for- 
mula G,,,, and when p > e the cube is divided into 2” parts and the process is 


repeated all over again for each of the parts, 

This method gives good results for computing double and triple integrals. 
As the number of measurements n increases, however, the application of the 
method runs into substantial difficulties arising from the fact that with m and 
m, fixed increasing n drastically increases the complexity of o, and o,, and 
bee am and m, decreased increasing n drastically increases the number of sub- 

ivisions. 

In conclusion we note that when computing an n-fold multiple integral not 
over an n-dimensional cube G, but over an arbitrary domain in E® one should 
first make a transformation converting the domain into an n-dimensional cube. 
Besides, there are cubature formulas for some domains of special form (the ball, 
sphere, etc.)*. 

28.3. Example of approximate calculation of a multiple integra}. Consider 
computing the fourfold integral 


R L an 22 
F(R, L,1)=\ rar { pap | ay | [H-+p%-+1*—2pr eos (g—y)}-*P dg 
0 0 6 6 


to some accuracy e for the values of parameters 
R = 1; 1.25; 1.53 1.75; 2; 2.25; 2.5; 2.75; 3; L = 0.8; 1 = 4. 
A change of variables that maps the domain of integration into a unit cube 
reduces the integral to the form 
1 4 


114 
F(R, Ly H)=(n}t- Re? [ J j f cre Lape + Rene 
= 000 @ 
—2RLpr cos 2a (p—)J-3/? rp dp dr dy dq. 


The integrand is smooth. It is natural therefore to nse in compating the 

integral a cubature formula based on (2.66). For each of the variables r and p 

it is natural to take the Gauss formula (a one-dimensional formula exact for 

algebraic polynomials), while for the variables ‘a and % it is better to take the 

trapezoidal formula (see Chapter 12 in [1]), for the integrand is periodic in each 

a these sanables; and for periodic functions the trapezoidal formula gives the 
est results. 


* Thus cubature formulas for the sphere have been studied in the works of 
S.L. Sobolev and his disciples. 
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Thus we get 
F(R, L, N= 
me my oma 


™1 2 
22RL \2 
=( mm ) by by py, py CnyCng™hy7hy % 
Ayal heet ks=t kyet 
x | H24-Les%. + Riz? —2LRz, 2, cos 2n take)" 
z Rs hy hy“ hs ™ 

here, (n,)» (C,,) are the nodes and weights of the corresponding quadrature foz- 
1oula), 

To choose the values of m, m,, and m, guarantecing a required accuracy 


debugging calculations are made, successively increasing the number of nodes 
and comparing the results obtained. 


CHAPTER 3 


IMPROPER INTEGRALS 





The concepts of (single and multiple) integral introduced earlier 
are not suitable for the unbounded domain of integration or for the 
unbounded integrand. 

In this chapter we shall show how to extend the notion of integral 
to these two cases. 





3.14. IMPROPER INTEGRALS OF THE FIRST KIND 
(ONE-DIMENSIONAL CASE} 


In this section we shall extend the concept of definite integral to 
the one-dimensional unbounded connected domain of integration. 

3.1.1. The improper integral of the first kind. One-dimensional 
unbounded connected domains are the half-lines ax<r< +o, 
—oo<2z< band the infinite straight line —coo <2 < +00. Con- 
sider for definiteness a <2 < +00. 

Throughout this chapter, without specifying it in what follows, 
we shall assume that the function f (z) is defined on the half-line 
a <x<+oo and that for any R >a there is a definite integral 


| #(@) dz which we denote by the symbol F (R): 


: R 
F(R)= j f(z) dz. (3.4) 


Thus under our hypotheses on the half-linea < R < +00 a function 
F(R) defined by relation (3.1) is given. We look at the limiting 
value of F (R) as R — +00, i.e. examine the existence of the limit 


R 
lim j f (x) dz. (3.2) 
R++00 a 

For the expression (3.2) we shall use the symbol 


\ j (x) dz. (3.3) 
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In what follows (3.3) will be called improper integral of the first kind 
of a function f (7) over the half-line a <r < +00. 

If the limit (3.2) exists, then the impreper integral (3.3) is said 
to he convergent. If, however, the limit docs not exist, the improper 
integral (3.3) is said to be divergent. 

Remark {. Consider the improper integral (3.3). If b > a, then 


along with this integral we may consider the integral \ f (x) dr. 


hb 
Obviously, the convergence of one of these integrals implies the 
convergence of the other. The following equation holds: 


co t a 
\ i (z)dr= \ j (z) dx = \ f (x) dz. 
@ b 


Note that the divergence of one of the improper integrals implies the 
divergence of the other. 

Remark 2. Jf the improper integra] (8.3) conyorges, the value of 
the limit (3.2) is denoted by the same symbo] (3.3). Thus, if the 
integral (3.3) converges, we use the equation 


~ R 
\ f(z)dr— lim  f(x)dz. 
. R-s00 + 


a 


h 


Remark 3. The definition of the improper integrals \ } (x) dr 


and ( f (x) dz is similar to that of the improper integral (3.3). 


. 


~c 
The first of them symbolizes the operation of proceeding to the limit 
b fie 


lim ( f(z) dz, and the second symbolizes lim ( Ff (x) dz. 
H-weos ¢ Ri-—co s 
R Hew ga 
Example. Consider on the half-line a<2z< co (a>0) the 
function f(z) = 1/2’, p = const. It is integrable on any interval 


arc, with 


zi-p : Ri-p—ai-p 
R Pauses = when of 
\ az 1~p {a 1—p P 
xP Rn . 
a Inz| = in — when p=1. 
a 
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Obviously, when p> 1 the limit lim © exists and is equal to 
R-co 


a 
1 
— and when p<<j it does not exist. Consequently, the improper 


foe] 


integral \S converges when p> 1 and diverges when p<i. Note 
a 
that when p>1 


\ dz ai-p 


"P p—1- 
a 
3.1.2. The Cauchy criterion for convergence of the improper in- 
tegral of the first kind. Sufficient tests for convergence. The question 
of the convergence of the improper integral of the first kind is equiv- 
alent to the question of the existence of the limiting value of the 


R 
function F (R) = j f (x) dz as R +-+0o. As is known*, for the 


limiting value of F (R) as R > co to exist, it is necessary and suffi- 
cient that F(R) should satisfy the following Cauchy condition: 
given any « >O we can find A > 0 such that for any R’ and R” 
greater than A 


5s 
| F(R)—F(R’)|=| | fla)ae|<e. 
2. 


The following statement is thus true. 

Theorem 3.1(Cauchy criterion for convergence of the improper 
integral of the first kind). For an improper integral (3.3) to converge 
it is necessary and sufficient that given any ¢ > 0 we should find A > 0 
such that for any R’ and R” greater than A 


R 
| | se ae|<e. 
Re 


Remark. Note that the convergence of an improper integral does 
not imply even the boundedness of the integrand. For instance, the 


integral ( f (z) dx, where the function is zero for nonintegral x 


0 
and equals m for z =n (an integer), clearly converges although 
the integrand is not bounded. 
Since the Cauchy criterion is inconvenient for practical applica- 
tions, it is appropriate to show the various sufficient tests for the 
convergence of improper integrals. 


* See Section 8.1 of [4]. 
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In what follows we shall assume that the function f (z) is on 
a<xz< mand that for any R > a there exists an ordinary inte- 
£ 


« 


gral | } (z) dz. 


a 
We prove the following theorem. 
Theorem 3.2 (general comparison test). Let on the half-line 
axr<o 


If (z)| <8 (z). (3.4) 


Then the convergence of {e (xz) dz implies the convergence of \ f (x) dz. 
a 


e 
Proof. Let j g (x) dz converge. Then, by the Cauchy criterion 


{see Theorem 3.4), given any e > 0 we can find A > 0 such that for 
any @’ >A and R”>A 
R° 
| [ g(z) dz| <ie. (3.5) 
R’ 


According to the ordinary inequalities for integrals and to inequality 
(3.4) we have 
Re R° n 
[| reaz|<[ ip @laz<| e@az. 
R R 


R 


From this and from (3.5) it follows that for any R' and 2” greater 
than 4 


n° 
| \ f(z)dz|-<e. 
iv 


Consequently, ( f (z) dz converges 


Theorem 3.3 (particular comparison test). Let on the half-line 
0<a<l2< ow the function f (x) satisfy the relation 


¢ 
If (Zia: 
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where c and p are constants, p > 1. Then J f (x) dx converges. Tf, 
however, there is a constant c > 0 such that on 0 << a<x< oo we 
have f (x) > < , where p <1, then j f (x) dx diverges. 

zw 


a 
The statement of this theorem follows from Theorem 3.2 and the 
example of the preceding subsection (it suffices to put g (x) = c/z?). 
Corollary (particular comparison test in the limiting form). 
If when p >1 there is a finite limiting value | f(z) | 2? =e, 
X-+ +00 


then | f (x) dx converges. But if when p < 1 there is a positive limiting 


a 
value lim f(r) 2? =c>0, then j f (x) dx diverges. 
X++oo 


a 
We shall show the validity of the first part of the corollary. To do 
this notice that the existence of a limit as z ++ oo implies the 
boundedness of the function z? | f (x) |, i.e. given some constant 
Co > 0 we have 


| f(z) [<co/z?. 


After that we apply the first part of Theorem 3.3. The validity of 
the second part of the corollary follows from the following argu- 
ments. Since c > 0, we can find g > 0 so small that e — se > 0. 
Corresponding to this e is A >0 such that when z >A we have 
e—e<f (x) 2? (this inequality follows from the definition of the 
limit). Therefore f (z) > <> and in this case the second part of 
Theorem 3.3 comes into play. 

3.1.3. Absolute and conditional convergence of improper integrals. 
We introduce the concepts of absolute and conditional convergence of 
enroper ieee Let f (z) be integrable over any closed inter- 
val la, RJ*. 


Definition 1, An improper integral j f (x) dx is said to be abso- 


lutely convergent if the integral | | f (z) | dx converges. 
a 


* Then so is | f (z) }. 
7—01684 
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Definition 2, An improper integral 


{ (z) dr is said to be condi- 


fionally convergent if if converges and \ |] (x) | dr diverges. 


eee! at" 8 


Remark. On putting g (z) = [| f (z) [ in Theorem 3.2 we see that 
the absolute convergence of an improper integral implies its conver- 
gence. 

Note that Theorems 3.2 and 3.3 establish only absolute convergence 
of the improper integrals under study. 

Here is another sufficient test for convergence of improper integrals, 
suitable in the case of conditional convergence. 

Theorem 3.4 (Abel-Dirichlet test). Let { (2) and g (z) be functions 
defined on asx < oo. Also let f (x) be continuous on axa << 20 
and have on it a bounded antiderivative F (x)*. 

Suppose further that g (x) not increasing monotonically on amzr< 
<I co lends to zero as x -» 4- co and has a derivative g’ (x) continuous 
on a<x< oo. Under these conditions the improper integral 


{ F(z) 4 (2) az (3.8) 


converges. 
Proof. We use the Cauchy criterion for convergence of improper 
re 


integrals. As a preliminary we integrate by parts \ f (z) g (x) dz 


iv 
on an arbitrary interval [2', R°], R”° > R’, of the half-line a< 
<r < oo. We get 


RY Rr” 
{4(2) # (2) de= F(z) (2) ig es i P (x) g! (x) de. (3.7) 
he’ re’ 


Under the hypotheses of the theorem /* (x) is bounded: | J (z) |< 
<< K. Since g (x) is not increasing and tends to zero as x —> -+- 00, 
we have g (z) >0 and g’ (z) <0. Thus, evaluating relation (3.7) 
we obtain the following inequality: 


Rn 
tft) e (2) dz |SK fe (Re (RNEK | (=a! (2) ae. 
iv 


* This means that F (r), which may be defined to be ( 7) at, satisfies for 


CS 


a 
all x 5: a the inequality [| F(z) | << AK, where K is a constant. 
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Since the integral on the right of this is g (R’) ~ g (R"), obviously 
a 

| { ree (w)az|<2Ke(R’). (3.8) 
ce 


Using this inequality it is not hard to complete the proof of the 
theorem. Let « be a positive number. Since g (z) »0Oas zr — > +00, 
for this « we can choose A so that when R’ > A we have e(Ry< 
< ¢/2K. From this and from (3.8) it follows that for any R’ and R” 
greater than A 


If reece dzj<e 
ES 


which, by the Cauchy criterion, guarantees the convergence of (3.6), 
The proof of the theorem is complete. 

Remark. The requirement on the differentiability of g (x) in 
Theorem 3.4 is superfluous. Theorem 3.4 can be proved by assuming 
only that g (x) is monotone and tends to zero as z — +00; to do this 
we should use the second mean value formula (Bonnet formula). 

Example 1. Consider the integral 


co 


{eaz, «>0. (3.9) 
i 


Setting f (x) = sin 2, g (x) = 4/z*, it is easy to see that the hypothe- 
ses of Theorem 3.4 all hold for this integral. Therefore the integral 
(3.9) converges. 


Example 2. Consider the Fresnel* integral sin z* dz, According 


0 
to Remark 1 in Section 2.1.1 convergence of one of the integrals 


co 


~o 
j sin x* dr and j sin x* dx implies the convergence of the other. 


0 { 
We therefore turn to the second of the integrals. We have 
ao foo) 
\ sinatdz= jzsin xt de. 
1 1 
Setting f (z) = «sin z* and g (x) = 1/x we can easily see that the 


hypotheses of Theorem 3.4 all hold and therefore the Fresnel integral 
converges. 


* Augustin Fresnel (1788-1827) is an outstanding French physicist. 
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3.1.4. Change of variables under the improper integral and the 
formula for integration by parts. Now we shall formulate the condi- 
tions under which the formulas for change of variables and for inte- 
gration by parts for improper integrals of the first kind are valid. 
Consider first the question of change of variable under the improper 
integral. 

We shall assume the following conditions to hold: 

(1) f (2) és continuous on the semiaris aS < 00} 

Q) a<qr< wisa set of values of some strictly monotone function 
z= g(t) given on w<Qt<o (or ~wo <!<aa) and having on 
it a continuous derivative: 

(3) g(a) =a. 

Under these conditians convergence of one of the following impraper 
integrals 


. 


\ f(xydx and \ flg())e! Wat (or— [Fed 2) dt} (3.10) 


implies the convergence of the other and the equality of the integrals. 

This statement is established using the following arguments. 

Consider a closed interval {a, 72]. Corresponding to it by the strict 
monotonicity of g (t) is an interval [a, 0) (or Ip, a) of the axis ¢ 
such that changing ft on {a, p] results in the values of x = g (ft) 
Alling fa. RJ, with g (p) = R. Thus for those intervals all the condi- 
lions of Section 10.7.3 of [4] hold under which the formuln for change 
of variable under the definite integral] is valid. Therefore 


R o a 
Wits) dx =: (fle (t)) ge’ (f) dt (or = _ \ f(g (t)) g’ (t)dt). (3.14) 
a a Pp 


By the strict monotonicity of z = g(t), R — c as p > oo, and 
conversely p — coas R —> co (or R + coas p + —coand p —- —oo 
as Ht ~- 09). Therefore formula (5.41) implies the validity of the 
above statement, 

Now welproceed to discuss the question of integration by parts of 
improper integrals of the first kind. 

We prove the following statement. 

Let functions u (x) and v (2) have continuous derivatives ona <xn< 
<2.00, and, in addition, let there exist a limiting value 

lim ou (z)vu (zr) -= A. 

New 
Under these conditions convergence af one af the integrals 

o ox 
\ u(z)u' (x) dr or \ u(r)’ (x) dx (3.12) 

a 


. 
a 
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implies the convergence of the other. Also 


[ u(x) v' (x) dx= A—u (a)v(a)-- \ v (x) uw! (x) dz. (3.13) 


To prove the statement consider a closed interva} {a, 2}, The usual 
formula for integration hy parts is valid on il. Therefore 


R R 
| (x) v' (x) d= [w(a) v (ay — J v (a) w! (a) de. 


Since as R — co the expression [uw (x) v (x)J® tends to A — u (a) v (a), 
the last equation implies simultaneous convergence or divergence 
of the integrals (3.42) and the validity of formula (3.13) in the case 
where one of the integrals (3.12) converges. 


3.2. IMPROPER INTEGRALS OF THE SECOND KIND 
{ONE-DIMENSIONAL CASE) 


In this section wo extend the concept of definite integral to the 
case of unbounded functions. 

3.2.4. The improper integral of the second kind. The Cauchy criterion. 
Let f (z) be a function defined on a half-open interval {a, b). The 
point b is said to be singular if f (x) is not bounded on la, b) but is 
bounded on any closed interval [a, b — a] contained in [a, b). It 
is also assumed that f (x) is integrable on any such interval. 

Under our hypotheses, on (0, b — a] the mension of the argument 
a is given defined by the relation 

b-a 


Fla)= J { (x) dz. 


We investigate the question of the right-hand limiting valuo of 
F (a) at the point a = 0, i.e. question of the existence of a limit 
b-o 
lim ( f(x) dz. (3.14) 
a-+0 . 
For the expression (3.14) wo shall use tho symbol 
b 
| (2) de. (3.45) 
a 
In what follows (3.15) will be called an improper integral of the 


second kind of a function f (x) on a half-open interval [a, b). If 
there exists a limit (3.14), then the improper integral (3.15) is said 
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to be convergent. But if that limit does not exist, then the improper 
integral (3.15) is said to he divergent. If the improper integral (8.14) 
converges, the value of the limit (3.14) is denoted by the same symbol] 
(3.15). Thus, in case (5.45) converges we use the equation 


4 bet 
\ f(2ldr= lim \ i(z) dz. 
: Re~t Pe 


Remark. The notion of improper integral of the second kind is easy 
to extend to the case where f(z) has a finite number of singular 
points. 

Example. Consider on [a, b) a function i(b — 2)" p> 0. It is 
clear that 6 is a singular point for that function. It is also obvious 
that the function is integrable on any closed interval fa, 6 — al, 
with 

pte a (b—s)!-» Le so (h ~n)'i-p - orp 


a7 = when pI, 


( dz = a i—p 
\ (b--7)P 





ass pm 2 
—In(h~s) . =IJn AS - when p=. 
v—z d y 
eid Sm Sagres ¥ . 3 y— ays! 
Clearly the limit lim | __ esists and is equal to ere) 
Qeotitt o (o—27) 1—/ 


a 
when p<ii and does not exist when p>. Consequently, the 
improper integral in question converges when p<i1 and diverges 
when p>=1. 

We now state the Cauchy criterion for convergence of the improper 
integral of the second kind. We shal) assume that f (x) is given on 
fa. 6) and that 4 is a singular point of the function. 

Theorem 3.5 (Cauchy criterion). For the improper integral of the 
second kind (3.15) to converge it is necessary and sufficient that citven 
any & > Owe should be able to find 6 > U such that for any a’ and a” 
satisfying the condition O<a”’ <a’ <6 


f.a° 


\ j(zjdr|<e. 


boa’ 


The validity of the theorem follows from the fact that the notion 
of convergence of an integral is by definition equivalent to the notion 
of the existence of a limiting value of 7 (a) introduced at the begin- 
ning of this subsection. 

3.2.2. Concluding remarks. We shall not expound the theory of 
improper integrals of the second kind. This is because the main 
conclusions and theorems of the preceding section may be carried 
over without difficulty te the case of integrals of the second |ind. 
Therefore we shall confine ourselves to some remarks. 


Ch. 3. Improper Integrals 403 


4°. Under some constraints on integrands integrals of the second 
kind reduce to integrals of the first kind. Namely, let f(x) be contin- 
uous on [a, 0) and let b be a singular point of the function. Under 


these conditions we can make the following change of variables in 
b-a 





J /@ a: 
4 dt 1 4 
BD ME pag Se 
As a result we get 
b-a 1/a 4 4 
{ f(z)de= | f(b—+)pd. (3.16) 
a 417(6-a) 


b 
Let j f(z)dzx converge. This means that there exists a limit 


a 

O-& 
lim \ f (x)dx. Turning to equation (3.16) we see that there is 
a-+0 
also a limit as 1/a-»-+- oo of the expression on the right of (3.16). 
This proves that the improper integral of the first kind 

tc 1) 4 
f(b —) qa 
if(b-a) 


b 
converges and is equal to f (x) dx. Convergence of the above impro- 
a 


b 
per integral of the first kind clearly implies convergence of j f (x) dx 


a 
and equality of the two integrals. So convergence of one of the integrals 


v co 
| f(@) dz or { 7(o-+)2at 

a 1/(b-a) 
implies convergence of the other and equality of the integrals. 

2°. For improper integrals of the second kind it is easy to prove 
statements similar to those of Section 3.1.2 which may be combined 
under the general heading “comparison tests”. Note that in all formu- 
lations f (z) is considered on [a, b), where b is a singular point of 
the function. 

A particular comparison test will have the following form. 

If | f (cz) | <c (b — z)-?, where p < 14, then the improper integral 
(3.15) converges. If, however, f (z) > c (b — z)-?, where c > 0 and 
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p > 1, then the improper integral (3.145) diverges. The proof follows 
from the general comparison test and the example considered in the 
preceding subsection. 

In analogy with Section 3.1.3 we could formulate for improper 
integrals rules of integration by change of variable and of integra- 
tion by parts. 


3.3. THE PRINCIPAL VALUE OF AN IMPROPER INTEGRAL 


Definition. Let f (z) be a function defined on a straight line — oo < 
<2 <0 co and integrable on every segment of that line. We shall say 
that f (x) is integrable in the sense of Cauchy (Cauchy integrable) 
if there is 


Rwto 


R 
lim \ f(x)az. 
<n 


We shall call this limit the principal value of the improper integral 
of jf (x) in the sense of Cauchy and denote it by the symbol* 
R 


Vip. i {(z)dz= Pie | fe) dz. 


Example 1. Find the principal value of the integral of sin z. 
Since by the oddness of sin z 


R 0 
( sinzdz=0, we have V.p. \ sinzdz=0. 
KR Jie 


The following statement is true. 

If { (x) is odd, then it is Cauchy integrable and the principal value 
of the integral of it is cero. 

Jf f (x) is even, then it is Cauchy integrable if and only if the improp- 
er integral 

oo 

( f(z)dz (3.47) 

0 
converges. 

The first part of the statement is obvious. To prove the second 
part it is sufficient to use the equation 

R R 

| f()dz=2 { f(a)as, 

=n rf 
~ * Vip, are the initial letters of the French words Valeur princtpal, “principal 
value", 
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valid for any even function, and the definition of convergence of 
the improper integra] (3.17). 

The concept of Cauchy integrability may be introduced for 
improper integrals of the second kind also when the singular point 
is an interior point of the interval over which we integrate. 

Definition. Let f (x) be defined on a closed interval la, b], except 
possibly a point c, a<(c <b, and integrable on any closed interval 
not containing c. We shall say that f (x) is Cauchy integrable if there: 
is a limit 

c-& b b 
lim ( { f(z) dxz+ [ f(x)dx) = V.p. j f(z) dz 
a~-+0 s a . 


ete 
called the principal value of the integral in the sense of Cauchy. 
Example 2. The function is not integrable on {a, 0], 


a<c<b in the improper sense. it is Cauchy integrable, how-- 
ever. We have 














6 c-a@ a te) 3 Fi 
‘2 d : iad 
Vip. { — = lim ( { — a { — )=In 1 ° 
D man ae +a 


3.4, MULTIPLE IMPROPER INTEGRALS 


This section extends the concept of multiple integral to the cases: 
of the unbounded domain of integration and of the unbounded inte- 
grand. Recall that it is these cases that were omitted by us from 
consideration when constructing the theory of multiple integrals. 

Note that we shall formulate the notion of improper multiple- 
integral so that it embraces both the case of the unbounded domain. 
of integration and the case of the unbounded function. 

3.4.1. Multiple improper integrals. Let D be an open set* of an 
m-dimensional Euclidean space Z™. We shall use D to denote the- 
closure of D obtained by adjoining to D its boundary. We shall 
need the concept of a sequence {D,,} of open sets monotonically 
exhausting the set D. 

We shall say that {D,} monotonically exhausts D if: (4) for any n 


the set D,, is contained in D4; (2) the union of all sets D, coincides 
with D**, 
Note that each set D, of {D,} is contained in D. 


* A set is said to be open if it consists of interior points only. An open set: 
is also called a domain. iS 
*#* Avunion of all sets D, is a set D containing all the points of each of the- 
sets D, and such that each point of D is in at Jeast one of the sets Dj. 
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Suppose on D a function f(z), 7 = (Ty, Ta, 6. ey Um) iS given. 
Riemann integrable on any closed cubable subset of D. We shall 
consider all possible sequences {D,} of open sets monotonically 
exhansting D and having the property that the closure 2, af every 
set 2, is cubable (from which in particular it follows that each of 
the sets D, is hounded). 

Tf for any such sequence {D,)} there exists a limit of the number 


Sequence { | f (x) dx} and that limit is independent of the choice of 


Dy 
sequence {D,}, then the limit is said to be the improper integral of 
the junction f (x) ever D and is denoted by one of the following symbols: 


( ] (x) dz, ( ( beat \ Pars Weschoke BVP dies ciate. (B48) 


dD D 


The improper integral (3.18) is called convergent. 

Nole that the symbol] (3.18) is used also when the limits of se- 
‘quences D, do not exist. Then the integral (3.18) is called divergent. 

3.4.2. Improper integrals of nonnegative functions. We shall prove 
the folowing theorem. 

Theorem 3.6. For the improper integral (3.18) of a function f (x) 
nonnegative in D to converge it is necessary and sufficient that for at 
least one sequence of cubable domains {D,,} monotonically exhausting D 
the number sequence 


an= | flx)az (3.19) 


n= 
a 
Dn 


should be bounded, 

Proof. The necessity of the hypothesis of the thearem is obvious: 
the sequence (3.19) is nondecreasing (), is contained in Dy4, and 
f (x) => 0), and therefore a necessary condition of its convergence is 
its boundedness. We proceed to prove the sufficiency of the hypo- 
theses of the theorem. Since (3.19) is bounded and is not decreasing, it 
converges to some number J. It remains to prove that to the same 
number / converges the sequence 


Da 


where {Dj} is another arbitrary sequence of domains monotonically 
exhausting D. Take any integer » and consider a domain D,. We 
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can find 7, such that Di, is contained in D,,,*. Therefore 

Qn<an, Sl. 
It follows that {a;,} converges to some number J’ < /. Interchanging 
in our arguments the sequences a; and a, we atrive at the inequality 
I<I’. Consequently. 7’ = J. This completes the proof of the 


theorem. 
Example. Consider the integral 


r=\ j e-s*-¥* dr dy (3.20) 
“D 


taken over an entire plane. Take the following system of concentric 
circles D,, to be a system of domains {D,} monotonically exhausting 


rtypraor, n=, 2... 


In each of such circles D, transform to a polar coordinate system r, 
q- We get 


2a 7n 
a,= \ ( e~**-¥* dx dy = { \ e-?rdrdg=xa(1—e-™). 
‘Dr 0 0 
It follows that lim a, =a. By the theorem just proved the 


tt— xe 
integral (3.20) converges and is equal to x. Note that the integral 
(3.20) may be represented as** 


l= i e-* ax \ e-!* dy =( j edz). 


From this representation we obtain the value of the integral called 
a Poisson integral***: 
x 


| e-dr=\/ nx. 


« 
—w 


* Suppose this is not the case. Then for any integer & we can find such a point 
MM), of the domain Dj, which is not in a domain D,. We can choose (by virtue of 
the closure and boundedness of Dy) a subsequence of the sequence {.V;,} con- 
verging to some point VW € Dz. The point 3f. together with some neighbourhood, 
helongs to one of the sets D,,. But then belonging to the same set D,, and to all 
the sets D, with large integers are points VM, with arbitrary large integers. But 
this contradicts the choice of point 1%. we 

** It is easy to sce that such a representation is possible. if we take as the 
exhaustive system of domains a system of increasing squares with centres at 
the origin and with sides parallel to the axes and then apply the formula for 
iterated integration over each of such squares. 

=** 5.D. Poisson (1781-1840) is a French mathematician and physicist. 
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we may write 
a 
On == Om \ ro-ptm=1 dr, 
ijn 


It follows that the sequence a, is bounded and hence converges 
if and only if p< m. By Theorem 3.6 the improper integral of 
{z |? in D converges when p< m and diverges when p > m. 

Example 2. Let a >0, D be the exterior of a ball of radius a 
with centre at the origin, and g (z) = |z |-”. Take a system of 
concentric fibres D, consisting of all the points x € E™ satisfying 
the condition 


ax<|z|[<n 


to be a sequence {D,} of domains monotonically exhausting D. 
Using a spherical coordinate system we get 
n 
y= \ g(x) dz = Om J r-ptm~1 dr, 
n a 


From this and Theorem 3.6 it follows that the improper integral 
of |z|-? in D converges when p > m and diverges when p < m. 
3.4.3. Improper integrals of functions that do not maintain sign. 
Here we shall discuss the relation between convergence and absolute 
convergence of multiple improper integrals. As in the one-dimension- 


al case, the improper integral j f (z) dz is said to be absolutely 
D 
convergent if the integral j | f (x) | dx converges. We shall prove 
D 


that absolute convergence of an integral implies the usual conver- 
gence. The most remarkable is another property of multiple improper 
integrals that has no analogue in the one-dimensional case, which is 
that convergence of an improper multiple integral implies its abso- 
lute convergence. In other words, we shall prove that for improper 
multiple integrals the concepts of convergence and of absolute conver- 
gence are equivalent. 

Before turning to the proof of these properties we shall make some 
preliminary remarks. 

It follows from the definition of the improper integral that if the 
improper integral over D of each of the functions f; (x) and f_ (z) 
converges, then so do the integrals of the sum or the difference of 
these functions. 

Consider the following two nonnegative functions: 


jA@= HW, 745 el=/e., (3.24) 
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Obviously they may be defined by the relations 


_ fitz), if f(xy. 
i+(2)= Yo, if f(r) <0, 
: —f(z), if fir)<o, 
Gs 0, if f(z)>0. 


Note also that the following obvious relations hold according to 
the definition of functions fs (7) and 7. (z): 


Osh @M<lf@Mb OS M<IT@)I (3.23) 
f (x) = fs (z) — f- @). (3.24) 
We now proceed to prove the statements made earlier in this subsec- 


tion. 
Theorem 3.8. The absolute convergence of a multiple improper 


integral ( f (x) dr implies its usual convergence. 


(3.22) 


D 
Proof, We turn to the functions f4 (x) and 7. (x) just introduced. 
The integrability in the proper sense of f (x) over any cubable subdo- 
main of D implies the integrability over D of { f (x) {[ and therefore 
from formulas (3.21) too it follows that f4. (z) and f. (x) are also 
integrable over any such subdomain. Using the convergence of 


( (f(r) { dz, the just indicated property of f, (7) and f. (x), in- 


D 
equalities (3.23) and Theorem 3.7, it is easy to see that the improper 


integrals [ Js (x) dx and ( j~ (x) dx converge. From this and from 
i) D 
relation (3.24) it follows that so does ( f (x) dx. The proof is com- 
b 


plete. 
Now we shall prove the converse. 


Theorem 3.9. If a multiple improper integral ( } (x) dx converges, 
D 
it does so absolutely. 

Proof. Suppose the statement of the theorem is false. From Theo- 
rem 3.6 then it follows that the sequence of integrals of | f (z) | 
over any sequence of domains {D,} monotonically exhausting D 
will be an infinitely large monotonically increasing sequence, Jt 
follows that {D,} may be chosen so that for any » = 4, 2, ... 


{ pie) lae>3 | f(z) pdx 2n. (3.25) 


Daar Dn 
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Denote by P, a set D, 4, — D,. Then from (3.25) for any n we get 


J 1f@) [ae>2 | 1 f(@) [de-+2n. (3.26) 
P, Dn 

Since | f (t) | = f+ (@) + f- (@), we have 
{ if (2) | de= ‘ fa (2) da+ \ f(a) de. (3.27) 
B, B, B, 


Suppose of the two integrals on the right of (3.27) the largest is the 
first. Then from relations (3.26) and (3.27), for any n 


{ fe @)az> J 1f@ lae+n, (3.28). 
Ps, Dy 
Divide the domain P, into a finite number of domains P,, so that 


the lower sum >) m;Ao; of f, (z) for this subdivision is different 
i 


from the integral over P,, of fs. (x) to so small an extent that chang- 
ing on the left of (3.28) the integral of that lower sum yields the 
following inequality: 


3) m,Ao, > j If (2) |datn. (3.29) 
i Dn 

Since m; > 0, it is possible to leave in > m;Ao; only the terms for 

which m; > 0. The union of the corresponding domains Pry will be 


denoted by Pe 
In a domain P,, the function f (x) is positive and therefore f (z) = 
= f, (z) in it. By (3.29) therefore we have 


f f (x) dxz> | | f(z) |dz+n. (3.30) 
fod Dn 


Pn 


é 


te by Di the union of D, and P,,. Adding inequalit ‘ 
ihe obvious inequality : " , nee 
r(ayae>— J IF (2) | ae, 


Dn 


Dn 
we then have 


(eee? (3.34) 


ak 
nr 
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‘Clearly the sequence of domains {2%} monotonically oxhausts the 


domain D. But then, by (3.51), \ T (x) er diverges. Since under the 
D 
hypothesis this integral converges, the assumption that the state- 
ment of the theorem is false does not hold. This completes the proof 
of the theorem, 
3.4.4. The principal value of multiple improper integrals. 
Definition. Let f (zr) be defined for all x € E™ and integrable in 
every ball K py of radius R with centre at the origin, We shall sau that 
f (x) is Cauchy integrable in E™ if there exists a limit 


lim | f(x) dz. 
Rew os 
Kp , 
This limit is called the principal value of the improper integral 
-of f (x) in the sense of Cauchy and designated 


V.p. j f(x) dxr= lim \ ‘f (x) dz. 
cS R-~w os 
Em Kp 
Example. Let f (x) have in spherical coordinates the form f (7) = 
= h (r) g (0, Oo, .-., Om-3), where the functions hk and g are 
continuous, with 


oa at 7 m4 
| @0, | d0,... \ £ (Or, Ony oy Ont) ( II sin! 0,,) d0m—1=0. 
0 


rf 0 hea 


Then clearly f (z) is Cauchy integrable and 
Vip. | f(2)dr=0. 


Sm 
E 


In particular, for m = 2 the function of two variables f (cz, y) = 
= h (r) cos p is Cauchy integrable and the integral of it in the sense 
of the principal value is zero. 

In the case where f (z) has a singularity at some point 2) of D 
the integral in the sense of Cauchy is defined as the limit 


Vip. ( f(z) dz = lim | f(a) dz, 
D R20 Dr 


where Dp is a set obtained by removing from D ao ball of radius & 
with centre at 2. 


_ CHAPTER 4 


LINE INTEGRALS 


In this chapter we extend the concept of one-dimensional definite 
integral taken over a line segment to the case where the domain of 
integration is a segment of some plane or space curve. 

Integrals of this kind are called line integrals. In applications it 
is customary to consider line integrals of two kinds (of expressions 
having a scalar and a vector meaning). In this chapter line integrals 
of the first and the second kind are discussed simultaneously. 


4.1. DEFINITION OF LINE INTEGRALS AND THEIR PHYSICAL 
INTERPRETATION 


Consider in the Ozy plane some rectifiable curve Z having neither 
points of self-intersection nor overlappings. Suppose that the curve 
is defined by the parametric equations 


r= @(t), 


awit) (ax<t<b) (4.4) 


and first consider it to be unclosed, with end points A and B. 
Suppose further that 


the function f (z, y) | the two functions P(z, y) and Q(z, y) 


are defined and continuous along the curve L= AB*. 

Divide the closed interval a<t<.b using the points a = t 
<t<t<...<t, =b into n subintervals [t,., t.] (k = 
= 1,2, ..., 7). 


* The function f (x, y) is said to be continuous along L if given any e >0 
we can find 6 > 0 such that | f (x1, y1) — f (ta, Yo) |< 2 for any two points 
(x1, yi) and (xp, ye) of L satisfying the condition VY (2, — 2a)" + (vi — ya)? < 5. 
In fact we have defined not the continuity but the uniform continuity of f (x, y) 
along i, but since the set of all points of Z is bounded and closed these notions 
coincide. 


8—01684 
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Since on L a certain point Af, (x), yx) with coordinates x), = 
= @ (t1), vx = tp (t,) corresponds to each value of t), this subdivi- 
sion of a<t< b divides the curve L = AB into n subarcs Mj, 
My Mla, . 0 oy Myiy dl, (Fig. 4.4). 

Choose on every subare 4f,_,4f, an arbitrary point Ny, (&, Ys) 
whose coordinates €,, 1), correspond to some value t of the para- 





Fig. 4.4 


meter ¢, so that €, = p(t), Mn = P(t), with th.) << tT <b, 
Let us agree to denote by Al, the length of the Ath subare 1/;,-.\), 
eae a eee) 


Form the integral sum Form the two integral sums 


nN n 
Oy a f (Ens 11) Ad. (4.2) O= S P (Ex, Nn) (Xp —~ Zp~1)s 


(4.2') 


n 
o3> = Q (Ens Wd (Yn — 1-1) 
to 
(4.2”) 


The number J is said to be the limit of the integral sum o, (s = 1, 2, 3) 
as the largest of the Jengths AJ, tends to zero, if given any e >0 
we can find 6 > 0 such that | a, — J | <e as soon as the largest of 
the lengths Ad; is less than 6. 


Definitions 
If there exists a limit of the If there exists a limit of the 
integral sum o, as the largest of | integral sum oa, (as) as the largest 
the lengths Al, tends to zero, then | of the lengths Al, tends to zero, 
this limit is said to be a line | then this limit ts said to be a line 
integral of the first kind of | integral of the second kind and 
f(z, y) along L and designated | designated 


| f(z, yal ( P (zx, y) dz[ ( Q(z, 1) dy}. 
/ R : 


AB AB 
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or 


' f(z, y)dl. 


AB 
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It is customary to call the sum 


(4.3) \ P(x, y)dx+ | Qe, y) dy 


AB AB 


the general line integral of the 
second kind and to designate it 
by the symbol 


\ P(x, y)dx+-Q(x, y)dy. (4.3’) 


AB 


Now we Shall give a physical interpretation of the line integrals 


we have introduced. 


Suppose a mass with linear 
density f(z, y) is distributed 
along the curve L. To compute 
the mass of the entire curve, it is 
natural to divide the curve into 
small segments and, assuming 
the density to vary little on each 
segment, to set the mass of each 
segment approximately equal to 
the product of some intermediate 
value of density by the length 
of that segment. 

In such a case the mass of the 
entire curve will be approximate- 
ly equal to the integral sum 
(4.2). The exact value of the 
mass is naturally defined to be 
the limit of the sum (4.2) as 
‘the length of the largest segment 
tends to zera. 

Thus the line integral of the 
first kind (4.3) gives the mass of 
a curve the linear density along 
which is equal to f (x, y). 


Suppose a_ particle moves 
along the curve L from A to 


B under the force F (x, y) with 
components P (zx, y) and Q (z, y). 
To compute the work done by the 
force to move the particle, it is 
natural to divide the curve LZ 
into small segments and, assum- 
ing the force to'vary little on each 
segment, to set the work on each 
segment approximately equal to 
the sum of the products of the 
force components taken at some 
intermediate points by the dis- 
placement vector components. 
In such a case all the work done 
by the force on the particle to 
move it from A to 8 will be 
approximately equal to the sum 
of (4.2’) and (4.2%). The exact 
value of the work is naturally 
defined to be the limit of that 
sum as the length of the largest 
segment tends to zero. 

Thus the general line integral 
of the second kind (4.3’) gives 
the work done by a force, with 
components P (x, y) and Q (z, y), 
on a particle to move it along the 


| curve L from A to B. 


Remark 1. It is obvious from the form of the sums (4,2), (4.2’) 
and (4.2”) that the line integral of the first kind is independent 


gt 
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of the direction in which (from «{ to B or from B to A) the curve 
L is travelled while reversing the sense of the curve results in revers- 
inv the sign, i.e. 


| Piz, dr=— \ Piz, mdz, \ Qe. mdy= — | Q(z, w)dy. 


AR Ba Ys) BA 


oy 


Remark 2. Quite similarly introduced for the space curve are 
the line integral of the first kind [ f(z, y, 2) dl and the three line 


AB 
intevrals of the second kind 


\ P (x, y, 2) dx, Q(x, y, 2) dy, R(z, y, 2) ds. 
AB AB AB 

It is customary to call the sum of the last three integrals the general 
dine integral of the second kind and to designate it by the symhol 


( P (xz. y, c)dx+Q (2, y, s)dy+ Rr, yy 2) dz. 
AB 


4.2. EXISTENCE OF LINE INTEGRALS AND REDUCING THEM 
TO DEFINITE INTEGRALS 


Let us agree to say that the curve Z is smooth if the functions op (t) 
and wp (¢) of the parametric eqnations (4.1) defining it have on [a, b] 
continuous derivatives gp’ (tf) and w’ (0)*. 

The curve Z will he said to be piecewise smooth if it is continuous 
and splits into a finite number of pieces with no interior points in 
common, each piece being a smooth curve. 

According to what was agreed upon as far back as Chapters 15 
and {6 of [1], the points corresponding to (he value of the parameter ¢ 
for which the derivatives m’ (!) and sp’ (f) both vanish will be called 
singolar points of the curve 4. 

We shall prove that df the curve L = AB is smooth and does not 
contain singular points and if the functions f (x, y), P (x, y) and 
Q (x, u) are continuous along the curve, then the following formulas 


* By this we mean that the derivatives q’ (t) and yf’ (f) are continuous at any 
interior point of {a. }] and have finite limiting values at the paint @ fram the 
right and at b fram the Jeff. 
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reducing line integrals to usual definite integrals are valid 


\1@ nal= | P(e, yar= 
AB AB 
v 6 
= J fig (t), »(t)] x = J P(,(t), p(t)] 9" (t) at, (4.4') 


xViv OP +I WFa. (4-4) | | Q(e, yay= 
AB 


b 
= | Qie(), PO)» Wat. (4.4) 


At the same time we shall prove the existence of all line integrals occur- 
ring in these formulas. 

We notice first that the definite integrals on the right of (4.4), 
(4.4'), and (4.4") a fortiori exist (for under our hypotheses the inte- 
grands in each of these integrals are continuous on a < ft < J). 

For the line integral of the second kind we shall derive only formu- 
la (4.4’) (for derivation of (4.4") is quite similar). 

As in Section 4.4 we divide the interval a<ct< b by means of 
the points a=t<t,<ip,<...<t%, = 0b into m subintervals 
and form the integra) sums (4.2) and (4.2’). 

Now we take into account the fact that 


Al, = Xp_— Tp-1 = Y (tx) — P (tat) = 
th tk 

= | Vie @F+ Ora. | =) wa. 
tha thea 


This allows us to rewrite the expressions for (4.2) and (4.2') as follows 


O= S{F Iw (ta) (te x — | Co= DY {Pw (ta), Y(t) X 
hod k=1 


ty, th 
x | Vip OFF mPa}. | x | oat}. (4.5') 
he thoy 
45) 


(We have also taken into account the fact that &, = @ (Tx), Nn = 
= tp (t,), where t, is some value of ¢ satisfying the condition t,-1 < 
Str < te) 
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Now denote the definite integrals on the right-hand sides of formu- 
Jas (4.4) and (4.4') by A, and A,, respectively. Dividinga <t<b 
into a sum of » subintervals [f,_,, t,] we may write the definite 
integrals A, and KX. as follows: 


n 'h nS, 
c= > \ Tig (d). 4 (t)) < Ky, = > \ P {gq (t), W(t)) x 
heily oy hadith iy 
«Vie (OP SEY (OF dt. XG (dt. 


Consider and evaluate the differences 


oy —Ay= 0,—Ka= 
nofh fs ty 

=D | Vim red- | =D ) Pied ve 
need tyes ASN thy 

FP), FO} A —~P ip (t), #(t))} p(t) dt. (4.6') 


KV Te (OF TY (OF dt. (4.6) 


Since x = ¢ (t) and y = tp (t) are continuous on a<t <b and 
f(z, y) and P (x, y) are continuous along Z, by the theorem on the 
continuity of a composite function (seo Section 14.3 of [1]) 
{lo @, p(@] and P(e (2), p(t] are continuous on ax<t<b. 

Now notice that as the largest of the lengths of the subarcs Al, 
tends to zero, so does the largest of the differonces (t;,— t,-,)*. 
But from this it follows that given any e > 0 we can find 6 >0 
such that provided the largest of the lengths A, is less than 5, each 
of the braces in formulas (4.6) and (4.6’) is less than e. Therefore, 
provided the largest of the lengths AJ, is less than 6 we obtain for 


th, 
* Indeed Al, = ( Vio’ OF (Ff Mf dt. Since ge’ (and 1" (t) ate 


‘ 
hey ‘ 
continuous on @<t<b and do not vanish together, the function 
Viv E+ (PE is continuous and strictly positive on aig. 
Therefore the minimum value m of the last function on a<Qt<gh is posi- 
{ 
a 


- : 4 
tive. But then Alp, > m \ dfs (ty —ty ay), dee ttn ae 


that 
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the differences (4.6) and (4.6’) the following evaluations: 


n th | 0,.—K2|< 
Jo—Kil<e 5) | x a th 
het thy <eD | iv’ @la< 
x Vie’ OF + te (OF dt = wtb 
b n tr 
=e | Vie OF+IW OP a= | <em 5) { at=eM (b—a), 
a are 
=el, 
where 2 is the length of the | where Af is the maximum value 
curve AB. of |p’ () | on axt<b. We 


stress that in deriving (4. 4’) we 
require only that 9’ (¢) should 
be continuous and that the curve 
L=AB should be rectifiable 
(it is not required that w’ (2) 
should be continuous). 


In view of the arbitrariness of © we may assert that the integral 
sums 6, and oO have (as the largest of the lengths Aj, tends to zero) 
limits equal to K, and K. respectively. This simultaneously proves 
the existence of line integrals on the left-hand sides of (4.4) and (4. 4') 
and the validity of these formulas. 

Remark 1. In the case of the piecewise smooth curve L it is 
natural to define line integrals along the curve as the sums of the 
corresponding line integrals over all smooth pieces forming the 
curve L. Equations (4.4), (4.4’) and (4.4") thus turn out to be true 
for the piecewise smooth curve LZ too. They are also true in the case 
where f (z, y), P (x, y) and Q (2, y) are not strictly continuous but 
merely piecewise continuous along L (i.e. where L splits into a finite 
number of pieces, having no interior points in common, along each 
of which the functions are continuous). 

Remark 2. Quite similar results and formulas are true also for 
line integrals taken over the space curve L = AB defined by the 
parametric equations 


z= {t), 
! y=P(t, (@<t<b). 
o= 4 4 (t)s 
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We confine ourselves to writing the formulas 


| f(z, 9,2) dl= | P(x, y, 2) dz= 
AB An 
i t 
Ate (Oh, 1). ZT x =| Pig (t), FO, ZOE a (de, 
yet (z, Y, 2) dy = 


j— 


— ir (OF 

» Vo sry or sig wnat. 
si gatonaens 
R 


\ (Z, ¥, 3)ds= 
AB 


bt 
= \ R Ip (t), y (t), Z(t)) A (t) dt. 


Remark 3. We have established above that the line integral of 
the second kind depends on the sense of rotation of the curve L = 
= AB. We should therefore specify 

y | what we mean by the symbol 


[ P(x, y)dz+Q(x, y)dy (4.7) 
L 

when J is a closed curve (i.e. when 
the point B coincides with A). 

Of the two possible directions of 
circulation about a closed contour L 
the direction in which the domain 
inside the contour remains to the 
left of the point tracing around the 
ok path is called positive*. In Fig. 4.2 

Fig. 4.2 the positive direction is repre- 
sented by arrows. 

We shall assume that in the integral (4.7) along the closed contour L 
this contour is always traced in the positive dircction. 

Remark 4. It is easy to show that line integrals have the same 
property that the usual definite integrals have (the proofs are similar 
to those presented in Sections 10.5 and 40.6 of [1]). Under more 
stringent hypotheses, however, these properties follow at once from 
formulas (4.4), (4.4’) and (4.4). 


* By convention such a direction of motion may be called a “counterclockwise 
motion”. 


— 
x 
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We list them as applied to line integrals of the first kind. 

1°. Linear property. If for either of the functions f (z, y) and. 
g(z, y) there is a line integral along the curve AB and if & and 6 
are any constants, then for the function [af (z, y) -+ Bg (z, y)I 
there is also a line integra] along AB, with 


| lof (@, y)-+Be (x, d=a | f@, yates | e@, yal. 
AB AB AB 


2°. Additivity. If the arc AB is made up of two arcs AC and CB 
and if for f (x, y) there is a line integra] along AB, then for f (z, y) 
there is a line integral along either of the arcs AC and CB. with: 


| fe, nal= | fe, walt { fle, nat. 
AB AC cB 


3°. The computation of the absolute value of the integral. If there 
is a line integral along AB of f (x, y), then there is a line integral 
along AB of |f (z, y) |, with 


[\ fe vy atl< | f(a, y) fal. 
AB AB 


4°, Mean value formula. If f (z, y) is continuous along the curve 
AB, then there is a point M* on that curve such that 


| fle, y)dl= 1-7 (mM), 
AB 


where / is the length of AB. 
Example 1°. Compute the mass of the ellipse £ defined by the 


parametric equations 

=acost 

{ : |) (O<t<2n) 
y=Obsint 


provided a > b> 0 and the linear density of mass distribution is 
= |yl- 
p The problem reduces to computing the line integra] of the firsh 
kind | ly 1a. 
Using formula (4.4) we get 


2m 


j jyjdl=b | \sint | Varsim? ep OP cost di= 
0 
L 


Pi 
=o | sint V@ sin? t+ 0 cost di — 
0 
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$22 


oa . 

—b \ sin? |’a?sin®=t +b: costt dl = 
at 

=—b { Va? —(at—E) cos® t d (cos t) + 


mens) 
e 9 


Va? — (a? — 6°) cos*td (cos t) = 2b (b+ a 


Vao—e 


where*™ ¢= = : 
Example 2°. Compute the line integral of the second kind 


[= | (2° —~ 2zy) dx -+ (y? —2zy) dy 


a 
where Z is the parabola y = z*, with —1 <2 <1. This parabola 
may be regarded as a curve given by the parametric equations 


us 
Using formulas (4.4') and (4,.4") therefore we have 


=f, 
ie fn (H1StSD). 
r , 14 
l= \ (2 — 213) dt + \ (t}— 203) ¢dt= — +. 
- -{ 


i 
* Recall that the number e is termed eccentricity in analytic geometry. 


CHAPTER 5 


SURFACE INTEGRALS 





In this chapter we shall consider integration of functions given 
on surfaces. In this connection we first investigate the concept of 
surface and the concept of surface area. 


5.4. THE SURFACE 


5.1.1. The surface. The mapping f of a domain* G in the plane 
onto the set C* of three-dimensional Euclidean space is said to be 
diomeomorphic if f is a one-to-one correspondence between the points 
of G and G* under which corresponding to any convergent sequence 
{4f,} of points of G is a convergent sequence {M7} of points of G* 
and corresponding to every convergent sequence {.1/%} of points of G* 
is a convergent sequence of points {7,} of G. In other words, a ho- 
meomorphic mapping of the domain G onto the set G* is a one-to- 
one continuous mapping of these sets. We shall say that G* is the 
image of G under homeomorphic mapping f. 

Consider the following example. Let G be a domain in the Ozy 
plane, (wu, v) the coordinates of a point AZ of that domain, zs = 
= 5 (\f) a function continuous in G, and G* the graph of that func- 
tion. Clearly the mapping f of G onto G* given by the relations 


LSU, y =v. =2(u, v) 


is a homeomorphic mapping of that domain onto G*. 

We introduce the concept of elementary surface. 

A set ® of points of a three-dimensional space is said to be an ele- 
mentary surface if it is the image of an open disk G under homeomorphic 
mapping of G into the space**. 

Using the notion of elementary surface we introduce the concept 
of the so-called simple surface. 

Before proceeding we introduce the notion of neighbourhood of 
a point of a set © of an Enclidean space Z°, 


* Recall that a domain is a set each point of which is an interior point. 
** We are considering three-dimensional Euclidean space, although we could 
consider Euclidean space of any number of dimensions and speak of two-dimen- 
sional surface in that space. 
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aA neighbourhood of a paint Vf of @ is the common part of di and 
the spatial neighbourhood of the point Af. 

A set D of points of a space is said to be a simple surface if that sz 
is connected* and any point of the set has a neighbourhood that is an 
elementary surface. 

Note that an elementary surface is a simple surface but that « 
simple surface is not an elementary surface in general. For instance, 

the sphere is a simple but nonelemen- 
tary surface. 

We formulate the concept of gen- 
eral surface. 

The mapping | of a simple surface G 
is said to he locally humeomorphic if 
each point of G has a neighbourhood 
that is homeomorphically mapped onto 

Fig. 5.1 its image. 

A set () of points of a space is said 
to be a general surface if it ts the image of a simple surface under 
its locally homeomorphic mapping into the space. 

Remark 1. Note that neighbourhoods of points on a general surface 
are introduced as the images of neighbourhoods of puints of that. 
siraple surface whose image is a given general surface. 

Remark 2. A simple surface is clearly a surface without self- 
intersections and without overlappings. A general] surface may have 
self-intersections and overlappings. For instance. the surface in 
Fig. 5.1 has self-intersections but is the locally homecmoarphic image 
of a zone of a cylinder and is therefore a genera] surface. 

5.1.2. The regular surface. We introduce the concept of regular 
(h-limes differentiable) surface. 

Al surface MD whose points have coordinates x, y, = is said to be regu- 
lar (k-times differentiable) ij for some k > 1 each point of has 
a_ neighbourhood allowing a h-time differentiable parametrization. 
This means that each of the above neighbourhoods is a hemecmor- 
phic mapping of some elementary domain G** into the plane (a. v) 
by means of the relations 


r=ar(u,v), yuytuery c= su, v) (5.4) 
in which the functions 2z(u. ct), y (u,v). = (u. v) are k-times dif- 


ferentiable in G. 
If & = 1, then the surface is usually said to he smooth. 





* Reeall that a setissaidto be connected if any two ef its points can be 
joined by a continuous curve consisting entirely of points of that ect. 
** A domain G in the plane is said to be elenentary if it is the iinage ef on open 
disk under honecworphic mapping of that disk onto the plane, 
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We shall also say that by means of relations (5.1) we introduce 
in a neighbourhood of a point on the surface a regular parametrization 
using the parameters u and v. 

Remark 1. If the whole of @ is given by the mapping (5.1) of G, 
then we shall say that a single parametrization is introduced on ®. 

A point of a regular surface is said to be ordinary if there is a regu- 
lar parametrization of some neighbourhood of it such that at that 
point the rank of the matrix 


a=(* Yu a (5.2) 


Ly Yy By 


is two. Otherwise the point of the surface is called a singular point. 

A domain G in the plane is said to be simple if that domain is 
a simple plane surface. For instance, the open ring is a simple do- 
main. 

We shall say that the function f (u, v) belongs to the class C* 
in G if it is k-times differentiable and if all its partial derivatives 
of order & are continuous in G. 

The following theorem is true. 

Theorem 5.1. Let G be a simple domain in the plane (u, v) and let 
xz(u, v), y (u, v), 2 (u, v) be functions of class C4, k > 1, given in G, 
with the rank of the matrix (5.2) equalling two at all points of G. Then 
relations (5.1) define in space a set D which is a regular k-times differen- 
tiable general surface without singular points. 

Proof. Obviously it suffices to show that using relations (5.1) 
gives a locally homeomorphic mapping of G onto ®. 

Let |%q (20, Yo. Z9) be any fixed point of D corresponding to the 
values (wp, Vp) of the parameters (u, v) (Fig. 5.2). Under the 
hypothesis the rank of the matrix A is two at a point (up, Vp). 


x 
Suppose for definiteness the determinant | Be a | of the matrix 


DvD DD 
A is nonzero at that point. Since the determinant is a Jacobian 


jet and is nonzero at the point (Uo, Yo) and x(u, v), y (u, Vv) 
have continuous partial derivatives in G, by the theorem on the 
solvability of a system of functional equations (see Theorem 15.2 
in {1]) there is a neighbourhood A of the point (xp, yo) in the 
Oxy plane such that in that neighbourhood there is a unique and 
k-times differentiable solution 


u=u(z, y), v=v(z, y) (5.3) 
of the system 

x(u, v)—xz=0, 

y(u, v)—y=0. 
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Fig. 5.2 


It follows from the above reasoning that some neighbourhood H 
of the point (x, yo) is a homeomorphic mapping of some neighbour- 
hood G of the point (wz, Uo) with the aid of the relations z = z (u, Vv), 
y = y(u, v) (the inverse mapping of H onto G is effected using 
relations (5.3)). 

Substituting expressions (5.3) for u and v in the relation s = 
== 2(u, v) we see that some neighbourhood @ of a point AY, on @ 
is the graph of the k-times differentiable function 2 = 2 (u (2, y), 
v(x, y)) = 2(z, y). But this means that using the function < (7, y) 
cfiects a homeomorphic mapping of a neighbourhood #/ of a point 
(Zo, Yo) in the Ozy plane onto the neighbourhood @ of the point Al, 
of @. It is obvious that the neighbourhood G of the point (u, vp) 
is homeomorphically mapped onto the neighbourhood @ of AJ, on 
@*. In other words @ is the image of G under locally homcomor- 
phic mapping into space and is therefore a genera) surface. This 
completes the proof. 

Remark 2. In the process of proving the theorem we have estah- 
lished that cach point Mo of a surface @ without singular points has 
a neighbourhood M which is 4-4 projected onto one of the coordinate 
planes and is therefore the graph of a k-times differentiable function 
(this was the function 2 (z, y) in the proof of the theorem). 





* Here we have used the obvious statement that a composition of homcs- 
morphic mappings results in a homeomarphic mapping. 
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Fig. 5,3 


Figure 5.2 shows points AJ, and No whose neighbourhoods are 41-4 
projected onto the Oxy and Ozz planes respectively. 

5.1.3. Defining a surface by means of vector functions. Consider 
a regular surface @. It is a certain set of points AJ with coordinates 
(x, y, 2) (Fig. 5.3). Denote by r (M) the vector going from the origin 
to a point Jf on the surface. Clearly r (MM) is the vector function 
of a variable point Af of the surface*. It is usually called the radius 
vector of the surface @. 

Let us turn to that neighbourhood of the point AJ which is the 
image of a homeomorphic mapping (5.1) of some elementary do- 
main G** (in Fig. 5.3 the neighbourhood is encircled by a broken Jine). 
Then clearly the coordinates x (u, v), y (u, v), 2 (u, v) of the point AY 
are the coordinates of the vector r (/). It is obvious that in this neigh- 
bourhood the function r (47) is the function of the variables u and v: 
r(M) =r (u, v). With the value of v fixed, the terminal point of 
the’ radius vector r (u, v) traces in the neighbourhood under consid- 
eration a curve called acurve u (or acurve v = const). With the value 
of u fixed, the terminal point of r (u, v) traces a curve v (or u = 
= const). These curves u and v are called coordinate curves on the 
surface @ jin the neighbourhood under consideration. 

A system of coordinate curves u and v may thus be introduced in 
some neighbourhood of each point of the surface @. It is sometimes 


* A vector function may be regarded as a collection of three scalar functions. 
Detailed information on vector functions is given in Section 12.4. We shall 
use it as need arises. 

** A domain G in the plane is aid to be elementary if it is the homeomorphic 
image of an open disk. 
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called a system of curvilinear coordinates on the surface (more precisely, 
in the neighbourhood under consideration), 

In Section {2.1 a geometrical interpretation of the dorivatives r, 
and r, of the vector function r (av, v) is given. These vectors are 
the tangent vectors of coordinate curves (see Fig. 5.3). 

Using the vectors r, and 7, one can see the geometrical meaning 
of the ordinary and the singular point of the regular surface. 

Recall that a point Jf of a surface is said to be ordinary if in 
a neighbourhood of the point we can introduce a parametrization 


Singular point Linc of singular potnts 


ra 


Fig. 5.4 


with the aid of equations (5.1) such that the rank of tho matrix A 
{see relation (5.2)) at the point is 2. Since the rows of A consist of 
the coordinates of r, and r, and tho rank of A is two, ry, and r, 
are linearly indopendent. So the ordinary point is characterized hy 
the possibility of introducing in a noighbourhood of the point a 
parametrization such that ry, and r, are linearly independent at 
the point J/. 

In Fig. 5.3 J is an ordinary point of the surface @. Figure 5.4 
represents the surfaces with singular points. 

5.1.4. The tangential plane and the normal to a surface. One-sided 
and two-sided surfaces. We have already introduced the concept of 
tangential plane to a surface which is the graph of the differentiable 
function < = (x, y) (see Section 14.4.2 of {1}). Recall that the tan- 
gential plano at a point Jf, was defined to be a plane having the 
property that the angle betweon that plane and the secant Moll 
(VF being an arbitrary point of the surface) tends to zero as Af tends 
to MW,. We have proved that if 2 (z, y) is a function differentiable 
at a point (79, Yo), then there is a tangential plane at the point 
Moy (To, Nov & (ro, Yo))- 

We shall show that there is a tangential plane at any ordinary 
point of a smooth surface. To do this it is clearly enough to establish 
that some neighbourhood of the ordinary point of the surface is 
the graph of the differentiable function. But in Section 5.4.2 (see 
Tomark there) we proved this property for any ordinary point of 
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a smooth surface. Consequently, there is a tangential plane at any 
ordinary point of a smooth surface. 

Remark 1. [t follows from the definition of the tangential plane 
to a surface @ that the tangent line at a point M, to any smooth 
curve* situated on the surface and passing through M, lies in the 
tangential plane to @ at M). Since r, and r, are tangential to the 
curves uw and v passing through M,, they are in the tangential plane 
at M,. 

We introduce the concept of normal to a surface M at a point My. 

The normal to a surface M at a point M, is a straight line passing 
through Af, and perpendicular to the tangential plane at M7). The 
normal vector to the surface at MM, is any nonzero vector collinear 
with the normal at M5. 

Let M, be an ordinary point of a smooth surface D and suppose 
that some neighbourhood ® of that point is defined using a vector 
function r (uw, v) such that the vectors r, and r, are not collinear 
at M@,. Then clearly the vector 


N = {Ir,r,] (5.4) 
is the normal vector to @ and the vector 
__[rur ol 
"= Trurel) (5.5) 


is the unit normal vector to ®. 

Remark 2. Since under the hypothesis the surface is smooth, 
the vector function WV (u, v) and the vector function n (u, v) defined 
by relations (5.4) and (5.5) respectively are continuous. There is 
thus a continuous normal vector field at some neighbourhood of each 
point of a smooth surface. 

The question naturally arises: is there global continuous vector 
field of normals on any smooth surface? It turns out that there are 
surfaces on which there are no global continuous vector fields of 
normals. An example of such a surface is the so-called Mébius strip** 
depicted in Fig. 5.5. (This surface is obtained from the rectangle 
ABB’'A' by pasting together the sides AB and A’B’ in such a way 
that the points A and 8’ and the points A’ and B coincide, see 
Fig. 5.5. 

A ae on which there is a global continuous vector field of 
normals is called two-sided. A surface on which there is no such global 
field is called one-sided. 

The plane, sphere, ellipsoid, one-sheeted hyperboloid are two-sided 
surfaces, the Mébius strip being a one-sided surface. 


* A curve LZ is said to be smooth if it can be given using the vector function 
r (t) of class C for which r’ (¢) = 0 (for more detail see Section 12.2). 
** A, Mobius (1790-1868) is a German mathematician. 


9—01684 
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We shall consider only two-sided surfaces in what follows. 

5.1.5. Auxiliary lemmas. Here we prove some statements we 
shal] need in further discussion. 

Lemma J. Let Afy be an ordinary point of a smooth surface @, 
Then some neighbourhood of My is 1-1 projected onto the tangenttat 
plane draun at any point of the neighbourhood. 


Fig. 5.5 


Proof. We show that for instance that neighbourhood @ of My 
possesses the property pointed out in the Jemma in which the normal 
at any point makes with the normal at AJ, an angle less than 2/4 





Fig. 5.6 


and which is 1-1 projected onto some 
disk in one of the coordinate planes 
(for instance, inthe Ory plane)*. Note 
first that the normals at any two points 
of @ make an angle less than 2/2. Fur- 
ther let @) lack the above property. 
Then for some point Af of @ we can 
find points P and Q of Msuch that the 
chord PQ is paralle) to the normal rs, 
at VW (Fig. 5.6). Consider the line of 
intersection of with a plane paral- 
lel to the Oz axis and passing through 
PQ. By the choice of the neighbourhood 
( the portion PNQ of the line liesin D 


andis the graph of the differentiable function given on the segment 
which is the projection of PQ onto the Oxy plane. By the Lagrange 
theorem the tangent at some point N of PNQ is parallel to the chord 


* The possibility of choosing such a neighbourhood @ etems from the 
following considerations. In Section 5.4.4 we noted (see Remark 2) that 
there is a continuous vector field of normals at some neighbourhood of an 
ordinary point on a surface. In a sufficiently small neighbourhood of Mp, 
therefore the normals make with the normal at Afy an angle less than a/4, 
We have also established that some neighbourhood of Af, Is 1-1 projected 
onto a coordinate plane. In that neighbourhood there is clearly a part that 
is projected onto some disk in the coordinate planc. 
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PQ and therefore to the normal ny, at Jf. But then the normal at 
N perpendicular to that tangent makes an angle of n/2 with the 
normal at Jf. But this is not possible since the normals at any two 


points of M (including 47 and NV) make an angle less than n/2. The 
contradiction obtained shows that the lemma is valid, which com- 
pletes the proof of the lemma. 

We introduce the concept of complete surface. A surface D is said 
to be complete if any fundamental sequence of points of © converges 
to some point of the surface. 

The plane, sphere, ellipsoid, one-sheeted hyperboloid are examples 
of complete surfaces. The open disk, any open connected set on a 
sphere are incomplete surfaces. Bounded complete surfaces and bound- 
ed closed parts of complete surfaces will be called bounded complete 
surfaces in what follows. 

We shall say that the part of @ has a size less than 6 if it can be 
placed in some sphere whose diameter is less than 6. 

The following lemma holds. 

Lemma 2. Let © be a smooth bounded complete surface without 
Singular points. There is 6 >> 0 such that any part of ® whose size 
is less than 6 is 1-1 projected onto the tangential plane passing through 
any point of that part. 

Proof. Suppose the statement of the lemma is false. Then for 
any 6, = 1/n,n =1, 2,..., there is a part D, of M whose size is 
less than 6, and which is not 1-1 projected onto the tangential plane 
at some point of it. Choose in every part M, a point MM, and select 
a subsequence of {//7,,} converging to some point 7, of @*. Consider 
a neighbourhood of M, satisfying the conditions of Lemma 14. 
With n sufficiently large, the neighbourhood wil] contain all parts 
@,. But then every part should be 41-1 projected onto the tangential 
plane (at any of its points) but this contradicts the choice of parts @,. 
The proof of the lemma is complete. 

The following lemma is true. 

Lemma 3. Let © be a smooth bounded complete surface without 
singular points. There is 5 > 0 such that any part of D whose size is 
less than § is 1-4 projected onto one of the coordinate planes. 

The proof of the Jemma is closely analogous to that of Lemma 2. 

Lemma 4. Let D be a smooth bounded complete two-sided surface 
without singular points. Then given any ¢ > 0 we can find 6 > 0 such 
that for the cosine of the angle y between the unit normal vectors at any 
two points of an arbitrary part ® of the surface whose size is less than 6 
we have the representation 


cos y = 1 — ao, (5.6) 
where |am |<. 


* Since ® is a bounded complete surface, such a subsequence can be chosen. 
9 , 
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Proof. Consider a vector field of unit normals n (Jf) continuous 
on @) (such a field exists, since Gis a two-sided surface). The vector 
function rn is uniformly continuous since is a bounded complete 
surface and hence a bounded closed sot. Given any e > 0 therefore 
we can find 6 > @ such that for two arbitrary points W, and Jf, of 
® the distance between which is less than 5 we have 

fn (M.) — n(4%)) |< V 2. (5.7) 
Since 


cosy = 1 $(n (Ma) —n (MT), 


putting 
cea 5 (0 (Mg) — 0 (MEE 


and using inequality (5.7) we see that relations (5.6) are true. This 
completes the proof of the lemma. 


5.2, SURFACE AREA 


5.2.1. Surface area. Let @ be a bounded complete two-sided 
surface. Divide @ with piecowise smooth curves into a finite number 
of parts @, each 4-1 projected onto the tangential plane passing 
through any point of that part**. Denote by A the maximum size 
of the parts @, and hy o; the area of the projection of @, onto the 
tangential plane at some point J, of the part @,. Further form the 


sum >) o; of all the areas. 


{ 
We state the following definitions. 
Definition 1. The number o is said to be the limit of the sum > Oo; 


i 
as A 0 if given anye > 0 we can find § > 0 such that for all subdi- 
visions of D with piecewise smooth curves into a finite number of parts 
, for which A < 6 regardless of the choice of points Mf, on the parts ©, 


|No—ol<e. (5.8) 
q 


oa eas 
* We have used the following relations: 


ne (Afyy=4, maf = 4, (Ag) 2 (3E,) = €08 y, 
Jn (Sta) (M4) cok (n2 (Mz) ~—2n (Als) n (My) En? (AL,)). 


** The possibility of such a subdivision is guaranteed by Lemma 2 of Scc- 
2 c 
tion 5.1.0. 
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Definition 2. If for a surface @ there is a limit o of the sums a or 


a 
as A -+0, then the surface is said to be squarable and the number o 
is said to be the surface area. 

Our immediate task is to find sufficient conditions for the squara- 
bility of a surface. We shall prove that smooth bounded complete 
two-sided surfaces are squarable., We 
shall simultaneously show the computa- 
tional techniques used to compute surface 
areas. 


At first sight it would be natural to approach 
the question of computing the area of a surface 
using approximation of the surface with poly~ 
hedra. This way is inefiectual. however. We 
shall show an example due to Schwarz* which 
demonstrates that the areas of polyhedra in- 
scribed into a smooth surface may increase un- 
boundedly as the number of faces increases and 
their size decreases. 

Let ® be a zone of a cylinder (Fig. 5.7). 
Divide @ with circles parallel to the bases of 
® into n equal parts. Next divide each of such 
circles into m equal parts as shown in Fig. 5.7. 
Depicted in the figure is also a polyhedron ®,,,, 
inscribed into ®. With any m fixed. the area 
of that polyhedron ,,, clearly exceeds by a 
factor of n that of the projection of the polyhedron onto the plane of the cylin- 
der base. Since the projection does not depend on n, by increasing n. with any 
m fixed, the area of the polyhedron ®,,, may be made arbitrarily large. 





5.2.2. Squarability of smooth surfaces. We shall prove the follow- 
ing theorem. 

Theorem 2. A smooth bounded complete two-sided surface without 
singular points is sguarable. 

Proof. Suppose asingle regular parametrization may be introduced 
on asurface @. In that case the radius vector r (.\/) of a variable 
point ® of the surface is the function r (u, v) of the class C1** given 
in some closed bounded domain Q in the plane of variables u and v. 
The partial derivatives r, and r, of r (u, v) are continuous vector 
functions independent of the choice of Cartesian coordinate system 


in space. The value o of \ | | (rz, rpj | du du therefore is indepen- 


dent of the choice of Cartesian coordinate system in space. We prove 
that @ is squarable and that its area is o. 


* H.A. Schwarz (1843-1921) is a German mathematician. 
ps By this it should be understood that each component of r (u, r) belongs 
lo CL 
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Let e be an arbitrary positive number taken to be fixed in further 
reasoning. Find for that ¢ >0 a number 6 > 0 proceeding from 
the following requirements: (1) any part @, of @ whose size is less 
than 4 is projected uniquely onto the tangential plane at any point 
of the part (D,; (2) the cosine of the angle y between the unit normal 
vectors al any two points of the part @, may be represented by 


cosy = 1 — Aas (5.9) 


where | “a, {<e/o and | dq, {<(1. The possibility of such a 
choice of 6 > 0 is guaranteed by Lemmas 2 and 4 of Section 5.4.5. 

Consider an arbitrary subdivision of @ by means of piecewise 
smooth curves into a finite number of parts @, whose maximum size A 
ig not greater than 6. Since there is a single parametrization on ®, 
corresponding to this subdivision of ® into parts @, is subdivision 
of a domain © into parts Q;. On every part @; choose an arbitrary 
point 7; and denote by o, the area of the projection of a part @, 
onto the tangential plane at 3/;. To compute a, proceed as follows. 
Choose a Cartesian coordinate system so that its origin coincides 
with J7,;, the Oz axis is directed along the normal vector to the sur- 
face at V/, and the Oz and Qy axes are in the tangential plane. In 
our coordinate system the surface is defined by the parametric equa- 
tions 2 = xr (u, v), y = y (u, v), 2 =< (u, v), and the vector [r,, r-] 
has the coordinates {4, B, C}, where 


Yu mu 


Ye <p 


Zu Zn Zu Gu 


Ty Ve 


Az . pe se . (5.40) 




















Zp Te 


Note that for the points of a part @,, in view of the choice of 6 and 
the orientation of the Oz axis, the number C is positive, C > 0. 
Also note that the cosine of the angle ys- between the normal at 
a point J of M, and the Oz axis is 


Cc 


cos Yy, = ———__—_ 
eT earl | 


(5.41) 


It is clear that yp , is the angle between the normals at the points Jf 
and V/, of the part (, and therefore representation (3.9) is true for it. 


We now turn to the integral \(rur,] | du dv which is clearly 
8 a a 
2 


t 45 
independent of the choice of Cartesian coordinates in space. Using 
the positivity of C and the third of the formulas (5.10) we get 














(\ Ururd fawde = (f nl ie . du dv. (5.12) 
2, Q; i Ue "tr oifp 
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Applying to the integral on the right of (5.12) the first mean value 
formula in generalized form we have 











. Z (2, e 
\ { | {rure] | dudu= (Tee tey | { \|z aoe j | duav, (5.13) 
a ia vel Jar 
where JJ is some point of @,;. 
Since 
{{rureJ i \ _ tt 
( Zu Uy } ™ COs Yur 
Zp Uy BM 
(see (5.10) and (5.141)), and \J ae dudv=of, from for- 





moula (5.13) and Jepeseadiacion (5.9) for cos yx¢ we find that 


a= \) | [rury] | du du— u I Hp, | [Ture] | du du. (5.14) 


Adding up equations (5.14) i. all parts @, and considering that 
x i Jlirarath age f ( |[rurol| dudv=o we get 
“o 


> o;=o— >} | | a | [rurp] | du dv. (5.45) 


i "Q: 
Evaluate the last term on the right of (5.15). We have 
[>| Hrurel (du do|<>, | {| [2,1] {rure) |dudv< 


| J a 
eo \ ) | [rule] | dudv=—- o=e. 


From this a from equation (5.15) we get 
|S o,—ol|<e. 
1 


Thus the surface @ is squarable and its area equals oc. 

We have considered the case where it is possible to introduce 
a Single parametrization on ®. In the general case PD may be divided 
into a finite number of parts, each allowing a single parametrization 


* We have used the formula for the area of a plane domain in transforming 
from coordinates (z, v) to coordinates (u, v) using the relations z = x (u, v), 
usu (u, v). 
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to be introduced*. After that the area of the surface may be defined 
as the sum of the areas of those parts. This completes the proof of 
the theorem. 

Remark 1. Let the surface @ be piecewise smooth, i.e. made up 
of a finite number of smooth bounded complete two-sided surfaces. 
Tho surface @ is clearly squarable, its area may be defined as the 
sum of the areas of the constituent surfaces. 

Remark 2. In the process of proving Theorem 5.2 we have estab- 
lished that if it is possible to introduce a single parametrization 
on @ and if the domain of the radius vector x (u, v) of M is a closed 
bounded domain 2 in the plane (u, v), then the area o of @ can be 
found from the formula 


o= | { [frure] [au dv. (5.16) 
ue 


If2=a(u, v), y = y (u, v), 2 = 2 (u, v) are paramotric equations 
of the surface, then the vector [r,r,] has the coordinates {A, B, C} 
defined by rolations (5.10). Since |[r,r,] | = VA® + BE 4+ C4, 
formula (5.46) may be written as 


o= | { VALE EC du dv. (5.17) 
“a 


Using the symbols 

rk=E, Paty = FP, ri = 
and the formula 

| [Purp] ] = V rir? —(rury)', 


expression (5.16) for the aren of a surface may also be written as 


o= |) VEG—F audv. (5.18) 
“a 


Remark 3. The area of a surface has the additive property: if 
a surface @ is divided by a piecewise smooth curve into parts D, and @, 
having no interior points in common, then the area o of @ ts equal 
to the sum 0, + 6, of the arcas of D, and @,. This property follows 
from the representation of area using the integral and from the addi- 
tive property of the integral. 





* We may use for example Lemma 3 of Section 5.1.5. By this lemma @ can be 
divided into a finite number of parts, each of which is 4-1 projected onto some 
coordinate plane and thus is the graph of a differentiable function. 
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5.3, SURFACE INTEGRALS 


5.3.1. Surface integrals of the first and the second kind. Let © be 
a smooth bounded complete two-sided surface. Let a function 7 (1%) 
of a point 37 be given on M. Denote by rn (3f) a continuous vector 
field of unit normals to @. 

We divide ® with piecewise smooth curves into parts @, and 
choose on each of such parts an arbitrary point 4J;. We introduce the 
following notation: A is the maximum size of the parts @;, o; is 
the area of ©;, X;:, Y;, Z; are the angles a vector nm (\J;) makes 
with the coordinate axes. 

Form the following four sums: 


I{®,, Uj}= = 7(M)o1, (5.49) 
1{®,, M,, Z;}= = 7 (M,) cos Z,0;, (5.20) 
1{Qj, Wi, Y= P3 f(41,) cos ¥4G;, (5.21) 
I {Q,, M,, Xi}= D 7 (A1,) cos Xy9;. (5.22) 


2 


For each of these sums we introduce the concept oi limit as A + 0+ 
We formulate this concept for the sums (5.19). For the sums (5.20), 
(5.24), and (5.22) the notion of limit is formulated in a similar way- 

Definition. The number I is said to be the limit of a sum 7 {®,, -if;} 
as A +O if given anye > 0 we can find § > O such that for anu subdi- 
visions of the surjace @ with piecewise smooth curves into a finite number 
of paris D, whose maximum size A is less than 6, regardless oj the choice 
of points Af; on parts MD, we have 


| I {®;, M,j—I ] <e. 
The limit [ of a sum /{®;, -f;} as A — 0 is called a surface inte- 
gral of the first kind of the junction jf (I) over M and designated 


t={{ fanas. (5.23) 
i 


If (z, y, 2) are the coordinates of a point 17 on ®, then for f (31) 
we may use the symbol f (z, y, z). In that case formula (3.23) may 
be written as 


I= \ 7 (xz, y. 2) do. (5.24) 


The limits of the sums /{@;, 3f;, Z;}, 2{®;, A/;, Y;}. and 
T{@;, 4;, X;} as A —0O are called surjace integrals of the second 
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hind of the function j (Mf) over @. For these integrals we use the fol- 
lowing symbols respectively: 


{| i(M)cosZdo, || f(atyeos¥ do, || f(alycosX aa 
is te 


oe 
a o 


or symbols similar to (5.24). 

Remark J. The definition of the surface integral of the first kind 
implies the independence of the integral from the choice of orientation 
of the vector field of unit normals to the surface or, as we say, from 
the choice of side of the surface. 

Remark 2, The surface integral of the second kind depends on the 
choice of side of the surface: reversing the orientation of the vector 
field of unit normals reverses the sign of all the three surface inte- 
grals of the second kind. This is due to the fact that in each of the 
sums (5.20), (5.21), and (5.22) the values of f (Af,) and o; remain 
unchanged under a change of orientation, and the values of the co- 
sines of the angles the normal nr (.\f;) makes with the coordinate axes 
change sign. 

Remark 3. Once a definite side of the surface is chosen, the surface 
integrals of the second kind may obviously be regarded as the surface 
integrals of the first kind over ® of the functions f (AJ) cos Z (34), 
7 (31) cos Y (MM), f (37) cos X (.) respectively. Indeed, once a defi- 
nite side of the surface is chosen, cosZ, cos Y, cos X are the functions 
of the point VU of @. 

5.3.2. Existence of surface integrals of the first and the second kind. 
Let @ be a surface satisfying the conditions stated at the beginning 
of Section 5.3.14. Choose on @ a definite side. By Remark 3 of Sec- 
tion 5.3.1, once a definite side of @ is chosen surface integrals of the 
second kind may he regarded as integrals of the first kind. Therefore 
we shall state sufficient conditions for existence only for the integrals 
of the first kind. 

The following theorem is true. 

Theorem 3.3. Let it be possible to introduce on a surface M a single 
parametrization by the function 

z=z(u,v), vp=yl(u, vj), c= 2 (u, v) (5.25) 
given in a bounded closed domain Q of the plane (u, v) and belonging 
to the class C' in that domain. If the function f (M) = f (z, u, 2) 
is continuous on (b*, then the surface integral of the first kind of that 





* The concept of continuity of the function of a point Jf given on some set 
{34} in space was formulated in Section 14.3.1 of [1]. In the case under con- 
sideration the role of {4} is played by @. 
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function over D exists and can be evaluated from the formula 


T= J f(M) do= 





=| [feu »), v(u, »), 2(u, 2) VEG—Fedu dv. (5.26) 
a) 


Proof. We want to prove that given any e > 0 we can find 6 >0 
such that for any subdivision of ® with piecewise smooth curves 
into a finite number of parts ©; for which A < 6, regardless of the 
choice of points 17; on the parts M; we have 


[7 {®,, M}— 
= [fl tew, v), YU, ¥), 2(%, LP) VEE—Fedudvi<e. (5.27) 
“9 


Let ¢ be any fixed positive number. Choose for this e > 0 a number 
5* > 0 so that the following two conditions should hold: 


(4) For any two points (w;, ¥;) and (u;, v;) of Q a distance less 
than 6* apart, 


| V/ BG, EM, PDF, M1) — 

—V Eli, 1G ty, 1) — Fn, OD) |< aap (5.28) 
where A is a positive number exceeding the maximum of the function 
| f (MZ) | and P is the area of Q; 

(2) For any subdivision of Q with piecewise curves into a finite 


number of parts Q,; whose size is less than 5* and for any choice of 
points (u;, v;) in every part Q; 


| Die (u4, vi), y (uj, V4); 2 (uz, v,)) x 


x VE (ty, vi) G (uy, V1) — F? (uy, ¥1) of — 
—{f fiz v), (4% v), 2(%, v) VEG—Fdudv|<z, (5.29) 
om 


where of are the areas of parts Q,;. 
The possibility of the required choice of 6* is guaranteed by the 


property of uniform continuity of the function / EG — F® continuous 


* f(z(u, v), y(u, v), z(u, v)) is the function obtained by superposing 
f(z, y, 2) and z= 2 (u, v), y= uu, ). s=:(u, v). By the theorem on the 
continuity of a complex function this function is continuous in Q. 
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in the bounded closed domain Q and by the property of integrability 
of the function f (x (u,v), y (u, v), 2 (u, v)) VEG — F? continuous 
in Q. 

We find 6 > 0 for 6* > 0 so that any subdivision of with 
piecewise smooth curves into a finite number of parts &, whose 
sizes are Jess. es 5 has a corresponding subdivision of Q into a finite 
number of parts Q; whose sizes are less than 5*. The possibility of 
a choice of Euctt § is guaranteed by the fact that @ is a homeomorphic 
mapping of 2 and therefore corresponding to each subdivision of 
with piecewise smooth curves into a finite number of parts W, is a 
subdivision of 2 with piecewise smooth curves into a finite number 
of{parts O,. If the maximum size of the parts (), tends to zero, then 
so,does the maximum sizo of the parts Q;. 

Now consider subdivision of @ with piecewise smooth curves into 
a finite number of parts @, whose maximum size A satishes A < 6, 
where 5 > 0 is chosen for 5* in the way shown above. Form for this 
subdivision a sum /{M,, 47;} using (5.19). Since the area o, of 


a part q), is | | VEe— F* du dv, denoting the coordinates of 
“n, 
a point J7, in the part , by (x (ty, Vy), Y (Uy, Uy) F (Ue, 7) We get 
I (QM, A) = 


= Df (x (tep, Vs), Y (gy Us), 2 (Uy Yy)) \ J V EG—F? du dv. 
i Q) 


Using the mean value theorem for the integrals on the right of the 
last relation we clearly may transform that relation as follows: 


I{QD,, AT }— ({ f(z (u,v), yu, v), 2(u, v)) VEG — Fe du dv= 
“a 


= [ Dy f(z (uy, 4), y (24, U1), z(t, v1)) “x 


¥ YO E(t, 1) G (Uy, vy) — F? (tg, 04) of — 
_ ( ( f (z(u,v), y (u,v), s(u, v)) VEG—F? du dv | + 
“@ 


i > f(x (Uy, Vt), y (ty, Ui), oo (ty, v;)) A 


ss [Vy E(u, By) G (wy, v1) — F2 (uy, t)— 
—V Flan vy Otis t= Pn Oot. 
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From the last equation, via inequalities (5.28) and (5.29), we easily 
obtain inequality (5.27). The proof of the theorem is complete. 
Remark 1. To compute the surface integral of the second kind 


[ [ f(z, y, 2) cos Z do once a definite side of M is chosen, we can 
“o 
clearly use the following formula: 


\f f(z, y, z)cosZdo= 
“o 


= j j f(x(u, v), y(w, v), 2(u, v) V EG—FecosZdudv. (5.30) 


2 


Similar formulas are true for the other two surface integrals of the 
second kind. 

Remark 2. Let a surface @ be the graph of the function z= 
=z(x, y) belonging to its domain of definition, D, to the class C}. 
Choose on ©® the side for which the unit normal vector rn (JZ) 
of ® makes with the Oz axis an acute angle. In that case cosZ= 


= where pase = Suppose on M a conti- 


nuous function R (zx, y, 2) is given. Considering then that z and 
y are taken to be the parameters wu and v on ® (@ is defined 
by the parametric equations z=z, y=y, 2=2(x,y)) and 
V EG—F2=V 1+ p?+ @, we may rewrite formula (5.30) as 


( \ R (a, y, 2) cos Zdo= | | Riz, y, 2(z, y)) VIF pe x 


Y D 
4 
= Vi-- ptt dx dy = \j R (x, Y, 2(2, y)) dz dy. 


This remark explains why we have the following notation for the 
surface integral of the second kind: 


{ j R (a, y, 2) cosZdo= \ j R(x, y, 2) dx dy. (5.34) 
@ 2 


Note that (5.34) is used also in the case where @ is not the graph of 


the function z = 2 (z, y). 
We shall consider surface integrals of the second kind having the 


following form: 


( j (P cos X + Qcos Y + Reos Z) do. 
“o ¥ 
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Such integrals will also be designated as follows: 


{ ( Pdyd:+Qdzdr+Rdzdy. 


(4) 


Remark 3. The concepts of surface integrals of the first and the 
second kind can naturally be extended to the case where ( is a piece- 
wise smooth surface. For such surfaces clearly the existence theorem 
proved in this subsection is also true. 

5.3.3. Surface integrals of the second kind independent of the 
choice of Cartesian coordinate system. From the definition of the 
surface integrals of the first and the second kind it follows that the 
integral of the first kind is independent of the choice of Cartesian 
coordinate system in space, whereas the integrals of the serond 
kind are dependent of its choice, for changing the coordinate system 
changes the values of the cosines of the angles which the normal rn (1/) 
makes with the coordinate axes. 

In the case where a vector function is given on the surface we can 
show a more general approach to the notion of surface integral of the 
second kind which allows us to speak in a sense of the independence 
of the value of the integral of the choice of Cartesian coordinate 
system jin space. 

So Jet PD be a smooth hounded complete two-sided surface on which 
a continuous vector function r (3) is given. Choose a definite side 
on @ and denote by x2 (A/) the vector field of unit normals to (D. 

Obviously the scalar product r (A) n (A7) is a continuous scalar 
function given on @ and is therefore independent of the choice of 
Cartesian coordinate system in space. Consequently, the surface 
integral of the first kind of that function 


| | r( M)n (M1) do 
“a 


is independent of the choice of Cartesian coordinate system in space. 
Use the coordinate notation of the scalar product r (Jf) n (M), 
assuming that the vector r (Af) has the coordinates P, Q, 7. Since 
the coordinates of n(4/) are cos X, cos Y, cos Z, we have 


r(M)n2(.M) = PcosX + Qcos ¥ + ReosZ 

and therefore 
[| r(aryn (at) d= \ | (Pos X-+Q cos Y + R cos %) do. 
‘t i 


The integral on the right of the Jast equation is the sum of the three 
surface integrals of the second kind and is usually called the general 
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surface integral of the second kind. Consequently, j ( r (M1) n (M) do 


may also be called the general surface integral of the second kind. 
Remark 41. If on the surface ® the three scalar functions P, Q, 


and R are given, the integral ( j (P cos X + Q cos Y+2R cos Z) do 


© 
may be written in the form invariant (independent) of coordinate 
system, assuming P, Q, and RF to be the coordinates of some vector 
function r (J7) given on the surface and writing the integral in the 


form ( { r (M) n (AM) do. Note that thereby we impose a certain 


@ 
law of transforming the integrand in transition to a new Cartesian 
coordinate system. In this case we obtain new coordinates of the 
vector r (Jf) which are calculated by the well-known rule of analytic 
geometry. However, this invariant form of notation for the surface 
integral is very conveniently used in various applications. 
Remark 2. Note that the general surface integral of the second 


kind j if r (Af) n (AY) do is numerically equal to the quantity 
®@ 
called by physicists the flux of the vector r (A7) through the surface @. 


CHAPTER 6 


BASIC FIELD THEORY OPERATIONS 





This chapter considers scalar and vector fields. It investigates basic 
operations of field theory. 





6.1. TRANSFORMATIONS OF BASES AND COORDINATES. 
INVARIANTS 


6.1.1. Conjugate vector bases. Covariant and contravariant coor- 
dinates of vectors. Lot ry, ¢ = 1, 2, 3, be a vector basis of a threo- 


dimensional space* (for the plane, i assumes values of 1 and 2), 
The basis r", : = 1, 2, 3, is said to be conjugate to the basis r, if** 
1, i=h, 
0. issh, 

The symbol 6% is called the Kronecker symbol***, 

The question arises as to the existence and uniqueness of the conju- 
gate basis. The answer to this question is yes: for a given basis r; 
there exists a unique conjugate basis r*, 

We shall see for example that a vector r! is uniquoly determined. 
According to (6.4) it is orthogonal to the vectors r, and rs. This 
uniquely determines the line of action of r', Next from the condition 
ryrt = 1 the vector r' itself is uniquely determined. Similarly, the 
vectors x? and r? are uniquely constructed. To show that r', r?, r° 
form a basis, it suffices to prove that r'r*r3 ~ 0. By the theorem 
on the product of determinants 


r= ot =| i, kai, 2, 3. (6.1) 


ret ry? ry 100 
ryPers) (irtr3) s=| ror! rer? rar? |=10 4 Of 4. 6.2 
1PoF"s 2 2 2 

ry! rar? rg} 100 4 





* Recall that ry, ra, ry form a basis if they are noncoplanar, f.c, if their 
triple product ryr.ry is nonzero. 

** Throughout this chapter ab denotes the scalar product of vectors a and b, 
abe denotes the triple product of vectorsa, b, and c, and (ab} symbolizes the vect- 
or product of a and b. 

*** Leopold Kronecker (1823-1891) is a German mathematician. 
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Since rors 0 (r,, re, M3 form a basis), it follows from (6.2) that 
riy’r3 = 0 either. 

Remark 1. If a basis r; is orthonormal, then the conjugate basis 
r* coincides with the given hasis r;. 

It is easy to see that the vectors r? of the conjugate basis in three- 
dimensional space can be found using the relations 


t= { Ferg] pS [737°] piss {r17'°2] 
ryol's ” ryPot's 7 Ty ers * 


Let r;, r® be conjugate bases, and let x be an arbitrary vector. 
Expanding x with respect to the basis vectors we get 


e=arr'tartagr, c= 2'iry+ rr, +25r3. (6.3) 


The numbers 2, Z2, 2, are called covariant coordinates of the 
vector z, and z!, x, x° are the contravariant coordinates of x. These 
terms are made clear in Section 6.1.2. 

To abbreviate the notation of formulas containing terms of the 
same type (relations (6.3) may serve as an example of such formulas), 
in what follows we shall employ the following convention. Suppose 
there is an expression made up of multipliers. If the expression has 
two identical literal indices, one superscript and the other subscript, 
it is considered that summation is taken with respect to these indi- 
ces: the indices are successively assigned the values of 1, 2, 3 and 
the resulting terms are then added up. For example, 


ayisayrit zor? ax,rs, Si = i+ 83+ 63, 
Sint" = (gy, z'x") 4- (Bon x2x*) + (gq, 232") = 
= (8442'xt + gyorix? + gygr'xs) + 
+ (goyr7x! + Soox?x? + Bogx?x9) + (g5 03x! + g5x322-+ gy,2575), 


Using the summation convention formulas (6.3) can be written 
in the following compact manner: 


a=anyri, w=x'r;. (6.4) 


Remark 2. The superscripts and subscripts mentioned in the 
summation convention are usually referred to as dummy indices. 
It is clear that dummy indices may be denoted by any letters, the 
expression they occur in remaining unaffected. For instance, 2;ri 
and x, represent the same expression. 

Remark 3. All arguments in this subsection referred to the case 
of three-space. In the two-dimensional case the literal indices take 
the values of 4 and 2. 

We obtain an expression for the covariant and contravariant 
coordinates of the vectors. To do this write the scalar product of 
the first of the equations (6.4) by r, and that of the second by r*. 


1060-01684 
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Taking then into account relations (6.4) we find that 

ary, = 2) (r'ry) = 28h = ys 

xr" = 2h (rprt) = 2l6f = 2", 
So 

z,=ar, 2=ar', (6.5) 
Using relations (6.5) we write formulas (6.4) as 

z=(zr,)r', x=(zr')r;, (6.6) 


Relations (6.6) are called the Gibbs* formulas. We again turn to 
the question of constructing conjugate bases. 
Using formulas (6.6) we get 


re(rryry, r= rrr. (6.7) 
Denoting 
ene 7 Ri phy 6.8 
Buran, Barr, (6.8) 
we rewrite relations (6.7) as 
rise gry, r= fart. (6.9) 


So it suffices to know the matrix (g*4) to construct the basis r* from 
r; and it suffices to know the matrix (g,;) to construct r, from r'. 
We prove that these matrices are reciprocal. To do this we write the 
scalar product of the first of the equations (6.9) by ry. Taking into 
account relations (6.1) we get 


1, j=hk, 
0, jth. 
These relations show that (g'!) and (g,;) are reciprocal. Since the 
elements of the reciprocal matrix can be calculated in terms of those 


of a given matrix, it is clear that using relations (6.9) solves the 
question of constructing conjugate bases. 


gay a 8} oa | 


6.1.2. Transformations of a basis and transformations of coordinates. 
Let r, and r*, i = 4, 2, 3, be conjugate bases, and let ry and rl be 
new conjugate bases. 

Using the summation convention we write formulas for transfor- 
mation of basis vectors. We have: 

(4) formulas for transition from the basis r; to a new basis ry 
and reverse formulas: 


resbbr,, ryp=biry, i, i= 4, 2, 3; (6.40) 





* Josiah Willard Gibbs (1839-1903) is an American theoretical physicist. 
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(2) formulas for transition from the basis r‘ to a new basis ré’ and 
reverse formulas 


ra plri, riabiri, i, i?’ =1, 2, 3. (6.44) 

Since the transformations (6.10) are reciprocal, so are the matrices 
(6;-), and (6; ). For similar reasons (bj ) and (bj) are also reciprocal. 

We prove that (bj) and (bj) coincide. This will prove that so do 
(bi) and (bi). To begin with, we obtain the scalar product of the 
first of the equations (6.10) by r* and that of the second of the equa- 
tions (6.11) by ry-. Taking then into account relations (6.1) we find 

rer = bi. (ryr*) = bi.62 = be, 

ring = bb (rrp) = bbh = Ob. 


From these relations we get 


be=ryr', (6.12) 
bh=ryr. (6.13) 


Since the right-hand sides of relations (6.12) and (6.13) are equal, 
so are the left-hand sides. In other words bi: = }- and this just 
means that the matrices (bi) and (63) coincide. Note that the ele- 
ments 0; of (bj) can be calculated from formulas (6.12). 

We may now say that to change from a basis rj, r* to rj, rit is 
sufficient to know only the matrix (bi) of transition from the basis 
r; to ry (the matrix (bY) is calculated from (b}.)). 

Here is a complete list of formulas for transformations of basis 
vectors: 


Par =bir; r; => BF ry, 
pete nase a (6.14) 
ri = bj r, r= bri . 
We proceed to derive formulas for transforming the coordinates of 


a vector when changing to a new basis. 

Let z;- be the covariant coordinates of x in the basis r;-, r’. 
According to (6.5) we then have 

rp Iz. 
Substituting into the right-hand side of this relation the expression 
for ry from formulas (6.14) we find 

zy x (bier;) = bie (r=) = biezx;. 
108 
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So formulas for transforming the covariant coordinates of a vector 
in changing to a new basis are the form 


ee ae (6.148) 


We see that in changing to a new basis the covariant coordinates of 
the vector x are transformed using the matrix (bj-) of direct change 
from the old basis to a new one. This concordance of transformations 
explains the term “covariant* coordinates of a vector’. Substituting 
into the right-hand side of zi = ar’ the expression for r in (6.14) 
we obtain the following formulas after transformations: 


zl = birt, (6.15) 


We see that in changing to a new basis the contravariant coordinates 
of x are transformed using the matrix (b}) of inversion from the new 
basis to the old one. This discordance of transformations explains 
why the term “contravariant** coordinates of a vector” is used. 

6.1.3. Invariants of a linear operator. The divergence and curl 
of a linear operator. Jnvariants are expressions independent of the 
choice of hasis. For instance, the value of the scalar function at a 
given point is an invariant. An invariant is an object vector inde- 
pendent of the choice of basis. A scalar product of vectors is also an 
invariant. 

Here we shal] discuss some invariants of a linear operator. Let A 
be an arbitrary Jinear operator defined on vectors of a three-dimen- 
siona] Euclidean space (i.e. A (ax + By) = alg + pAy Sor any 
vectors z and y and any real numbers a and fp). We prove that the 
expression 


rAr; = r,Ar i (6.10) 


is an invariant. 
We want to prove that in changing to another basis r,-, r” 


riAry=rl Ary. (6.17) 


Let ry, rl’ bea new basis and let (bi-) be the matrix of transition 
from the basis r,. ri tory, r’. We have 


, 
r,=b} Pi, rh bh 





* Covariant means concordantly changing. 

** Contravariant means changing in an opposite way. 
**« The validity of the equation rar, =:7;Ari can be seen from the follow- 
ing. According to (6.9) rl = gikr,, r, = gyrt. Considering that the matrices 
(gh) and (¢;)) are reciprocal and symmetrical we therefore get 


lar, =gthggyr Art = bhr, Ar! srpArk=ry,Arl, 
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Substituting these values for r; and r‘ in the expression r‘Ar; we 
get 


riAr, = (bi bh.) r® Arp. (6.18) 
Since (bi bie) = 6}, from (6.18) we get 
riAr, = Oper Ary =rt Ary. 


Equation (6.17) is thus proved, and hence so is the invariance of the 
expression riAr;. 

The invariant r‘Ar; of a linear operator A will be called the 
divergence of the operator and designated div A. Thus 

div A=riAr,=r;,Ar'. : (6.19) 


Remark. In a given basis r;, r‘ a linear operator may be given 
using a matrix called the matrix of the linear operator. It is the mat- 
rix of the coefficients a? of expansion of vectors Ar; with respect 


to the basis 7, (it is possible of course to consider the matrix of the 
coefficients of expansion of Art with respect to r*): 


Ar, = airy; ai=rAr;. (6.20) 
The divergence of the matrix of A may be expressed in terms of the 
elements of the matrix (aé). Namely 

div A=aj=ai-+a?--ai. (6.21) 


To see that formula (6.21) is valid it is sufficient to substitute the 
expression (6.20) for Ar; in the expression (6.19) for divergence and 
use the relation rir, = 6}. 


We prove that the expression 
[r,Ar*} = [r?Ar;]* (6.22) 


is also an invariant. We must prove that in changing from the basis 
r;, ri to another basis 7;-, rv 


[r;Ar*] = [rp Ar]. (6.23) 
Let rj, r’ be a new basis and let (bi,) be the matrix of transition 
from the basis r;, r° to ry, r’. We have 


-e ; F 
r= bj rn, r= Byer’, 





* The validity of {r,Ar‘] = [r?Ar;] can be seen from the following. According 
to (6.9) rt = gihr,, r; = g;,r!. Using the reciprocity and symmetry of (git) and 
(g;;) we therefore get 


[ri Arg] = gthgy, [ry Ar! = 8" [rpAr!) = [rp Ar’) = [rj Ar}. 
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Substituting these values for r; and r' in (r,Art] we get 


[ryeir’] <= (OY b) [re Ark’). (6.24) 
Since (61° bf,) = 6", from (6,24) we get 


[rp Art) = She [ry Ar!) = [re Art’). 


ae (6.23) is thus proved, and hence so is the invarianco of 
r,;Ar'}. 

The invariant {r,Ar‘] of a linear operator A will be called the curl 
of the operator and designated cur] A. Thus 


curl A= [ryAr'] = [ryAr) + [r.Ar*] + [r, Ar’). (6.25) 


We show the expression for the divergence and curl of the linear 
operator -l for the case of the orthonormal basis i, j, k. Since in 
this caso tho conjugate basis coincides with the given basis, by for- 
mulas (6.20) the elements aj,s5 of the matrix of A can be found from 
the formulas 


yy TAT, Ay =tAZ, ay, tAk, 
Qay==JAT, Aon =JAJ, Ao,= JAK, (6.26) 
Oy, == kAi, 30 =- kA], Q5,=KAhk, 


(in contrast to the general case we have denoted the elements of the 
matrix of A by am, instead of am). 


For the divergence of A we obtain the following exprossion: 


3 
divA= may App = 044+ Ang + O53 = CAEL JAS + AL. (6.27) 


i] 


We find the oxpression for the curl of A. Since in the case of the ortho- 
normal basis conjugate bases coincide, from (6.25) we get 


curl A = [iAi) + [jAj] + eA). (6.28) 


We ovaluate the first vector product [iA i). Since Ai = ayi + any + 
-+ ay,k, we have 


{tAt) = ayy, lit] + aa, [ij] + a5, (tk) = —ag,7 + aah 
Quite similarly we obtain the formulas 

[FA] =a3,f—ayhk,  [hAle] = —ag3f + ays]. 
Using these and relations (6.28) for curl A we find 


cur} ai ane (a3. — Qoq) t -- (ay — 254) ] + (Qo; =, 415) he. (6.29) 
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6.2. THE SCALAR FIELD AND THE VECTOR FIELD. 
BASIC CONCEPTS AND OPERATIONS 


6.2.1. The scalar field and the vector field. Let 2 be a domain in 
the plane or in space. 

A scalar field is said to be given in Q if associated with each point 
M of by a certain law is some number u (MM). 

Note that the concepts of scalar field and function defined in Q 
coincide. The following terminology is commonly employed: a scalar 
field is given using a function u (M). 

The notion of vector field is introduced quite similarly: if associat- 
ed with each point M in Q by a certain law is some vector p (M), then 
a vector field is said to be given in Q. We shall employ the terminology: 
a vector field is given using a vector function p (M). 

The temperature field inside a heated body, the field of mass 
density are examples of scalar fields. The velocity field of a steady- 
state liquid flow, magnetic intensity field are examples of vector 
fields. 

6.2.2. Differentiable scalar fields. The gradient of a scalar field. 
The directional derivative. We have already noted that the notions 
of scalar field u (/) in a domain Q and function defined in that field 
coincide. We may therefore define the differentiability of a scalar 
field as the differentiability of the function giving that field. For 
convenience we shall formulate the notion of differentiability of the 
field employing terminology somewhat different from the usual 
terminology. 

A linear form f (Ar) in a vector Ar is the scalar product of that 
vector by some Ar-independent vector g. We shall also use the nota- 
tion: 

p =e (M, M’) is the distance between points Af and M’, 

Ar = MM’ is the vector connecting Mf and M', 

Au = u (M’) — u (M) is the increment of the field at M. 

We give the following definition. 

Definition 1. A scalar field u(M) is said to be differentiable at 
a point M of a domain Q if the increment of the field Au at M may 
be represented in the following form: 


Au = f (Ar) + 0 (p), (6.30) 


where f (Ar) is a linear form in a vector Ar. 

Relation (6.30) will be called the differentiability. condition of the 
field uw (M) at a point M. 

Remark 1. Since a linear form f (Ar) is a scalar product g-Ar, 
where g is a Ar-independent vector, the differentiability condition 
of w(M) at Af may be written as 


Au = g-Ar + 0 (p). (6.31) 
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We prove that if a scalar field wu (1/) is differentiable at a point V, 
then the representation (6.30) (or (6.34)) for the increment Au of 
that field at J/ is unique. Let 

Au = g-Ar + 0, (p) and Au = h«Ar + 04 (p) (6.32) 


be two representations of the increment Au at jf. From formulas 
(6.32) for Ar £0 we obtain the relation 








(g—he= 38, (6.33) 
where e= aa is the unit vector and o(p)=0,(p)— 0, (p). Since 
a= 20. is an infinitesimal as p> 0, it follows from (6.33) 


that (g—h)e=0 for any e, ic. g=h. The uniqueness of the 
representation (6.30) is thus proved. 

We shall say that ascalar field u (Af) given in a domain Q is differ- 
entiable in Q if it is differentiable at each point of Q. 

Definition 2. The gradient at a point AI of a scalar field u (MM) 
differentiable at that point is a vector g defined by relation (6.33). 

The gradient of a scalar field is designated grad wu. 

Remark 2. The above definition of the differentiability of a scalar 
field is convenient in that it has an invariant character independent 
of the choice of coordinate system. The gradient of a scalar field is 
therefore an invariant of that field. 

Remark 3. Note the following important fact: if a scalar field 
u (AI) given in a domain Q is differentiable in that domain, then the 
gradient grad u of the field is defined at each point of Q and is obviously 
a vector field given in Q. 

Remark 4. For the scalar field we introduce the concept of level 
surface (level curve for the plane field) which is a set of points on 
which the values of the field wu (A7) are the same. The gradient of 
the field at a point JJ is orthogonal to the level surface at that 
point. The reader will easily see for himself that this remark is 
valid. 

Using the symbol grad u for the gradient of a scalar field we rewrite 
relation (6.34) in the following form: 


Au = grad u-Ar + 0 (p). (6.34) 

Note that the term grad u-Ar is usually called the differential du 
of the scalar field. Thus 

du = grad u- Ar. (6.35) 

Let us agree to employ the term differential dr for the increment 


Ar of the radius vector r = OM, Ar = OAT’ — OMT. Formula (6.35) 
for the differential du of a scalar field may be written as 


du = grad u-dr. (6.36) 
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Let two differentiable fields u (JZ) and v (Af) be given in 9. The 
following relations are true: 


grad (u-+v)=grad u+ grad v, 
grad (uv) =u grad v+vegrad u, (6.37) 
grad (ee (for v= 0). 


ye 
If F is a differentiable function, then 
grad F (u) = F’ (u) grad u. (6.38) 
The derivations of formulas (6.37) and (6.38) are of the same type. 
As an illustration, we show the validity of the second of the formu- 
las (6.37). Using formula (6.34) and the continuity of the function 
u (M7) we have 
A (uv) =u (M"')v (M"')—u (M) v (M) = 
=u (M’')Av+v(M) Au= 
=(u (M) grad v+v (A) gradu) Ar +o (p). 


From these relations it follows that the increment A (uv) may be 
represented by the form (6.31). Therefore wv is a differentiable func- 
tion and grad (uv) = u grad v + v grad u. The second of the formu- 
las (6.37) is thus proved. 

We introduce the concept of directional derivative for the scalar 
field. 

Let a field wu (J7) be given in Q, let AZ be some point of 2, and 
let e be the unit vector indicating the direction at M. Also suppose 
that M’ is any point in Q other than M and such that the vector 
MM’ is collinear with e. The distance between J and JM’ is denot- 
ed by p. 

If there is a limit 

lim 44% 

p+0 
(Au = u (M’) — u (M)), then this limit is said to be the derivative 
of the field u at M with respect to the direction e and designated =. 


Thus 
Je = him. (6,39) 
The following statement is true. 


Let u (M) be differentiable at a point M. Then the derivative S of 
u at M with respect to any direction e exists and can be found from the 
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formula 


~ = grad u-e. (6.40) 


We prove this statement. Let e be any fixed direction and Jet the 


point Jf’ be taken so that the vector Ar = JfAf' is collinoar with ¢. 
It is clear that Ar = pe. Substituting the value of Ar in relation 
48.34) we find 


Au = (grad u-e) p + 0 (p). 
From this we obtain the formula 


= =grad ue 2er, (6.41) 


Relations (6.39) and (6.41) yiold formula (6.40). This proves the 
statemont. 

We find the expression for the gradient of a differentiable 
scalar field assuming that in space an orthonormal basis i, j, k 
is chosen referred to a Cartesian coordinate system Oxyz. Sinco 


grad u=i (grad u-i) + 7 (grad u-j)+-k (grad u-k) aad ==, 
ou dus Ou du 


ai ee Oe ae? using relations (6.40) wo get 


_» Ou - Ou Ou 
grad “=U Ox +7 ty tk ee ° 


Using the exprossions (6.40) for the directional derivative gives 
the following graphical picture of distribution of the values of 
directional derivatives of the field 
w (MM) ina plane domain Q al a given 
point Af. Let grad u 0 (if gradu =0, 
then it follows from (6.40) that 
s = 0 for any e). On the yector grad 
uas diameter (Fig. 6.1) wo construct 
a circle C. We also construct a circle C* 
as large as C and touching it at J. 
Fig. 6.1 Let e bo an arbitrary direction. Draw 

through Af a half-line in tho direction 


of the vector e. If the half-line touches C and C*, then ie =0 (the 


vector e is orthogonal tograd uw). If, however, the half-line intersects 
‘C or C* ina point NV, then Sis equal to the length of JIN taken 
with the plus sign when NV is on C and with the minus sign when MX is 
on C*, Pora field in space the cirecles C and C* must he replaced 


with spheres. 
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6.2.3. Differentiable vector fields. The divergence and curl of a vector 
field. The directional derivative of a vector field. Let a vector field 
p (Mf) be given in a domain Q of a three-dimensional Euclidean 
space. In what follows we use the notation: Ar = MM’, Ap = 
= p (M’) — p (M). 

We give the following definition. 

Definition 3. A vector field p (M) is said to be differentiable at 
a point AL of Q if the increment of the field Ap at M may be represent- 
ed in the following form: 


Ap = Abr + 0(| Ar }), (6.42) 


where A is a linear operator independent of Ar (independent of the 
choice of point M'). 

Relation (6.42) will be called the differentiability conditions of 
a field p(M) at a point M. 

We prove that if p (MM) is differentiable at M, then the represen- 
tation (6.42) for the increment Ap of p (M) at AZ is unique. 

Let 


Ap = AAr + 0,(| Ar |) and Ap = BAr + 0,(|Ar|) (6.48) 
be two representations of Ap at M. For Ar = 0 formulas (6.43) give 


a 2 {tarl) 
(A—Bye=— (6.44) 


where ex is the unit vector, 0(|Ar|) =0,({Ar|) —o, (|Ar|). 
Since ae is an infinitesimal vector as Ar-»+0 and e is an 
arbitrary unit vector, it follows from (6.44) that (A—B)e=0 
for any e, i.e. A=. This proves the uniqueness of the repre- 
sentation (6.42). 

We shall say that a vector field p (M) given in a domain Q is diffe- 
rentiable in that domain if it is differentiable at each point of Q. 

We introduce the concept of directional derivative for a vector 
field p (M). 

Let the field p (JM) be given in a domain Q, let M be some point 
of 2, and let e be the unit vector indicating the direction at J/. 
Also suppose that M’ is any point in Q other than M and such 
that the vector MM’ is collinear with e. The distance between M 
and M’ is denoted by op. 

If there is a limit 

lim AZ 

p+o P 


(Ap = p (M') — p (M%)), then this limit is said to be the derivative 
of p(M) at M with respect to the direction e and designated <P : 
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Thus 
OP Him SP. B45 
we = an ?p ° (6. 1a) 


The following statement is true. Let a field p (A/) be differentiable 
ata point A of Q. Then the derivative of the field p at that point 
with respect to any direction e erists and can be found from the formula 


op 2 ep 
ee ae Ae, (6.46) 


where A is a linear operator defined by relation (6.42). 

We prove this statement. Let e be any fixed direction and Ict 
the point Af’ he taken so that the vector Ar = pe and | Ar | = p. 
Substituting this value of Ar in relation (6.42) and using the prop- 
erties of a linear operator we find 

Ap = pAe + 0 (p). 


Prom this we obtain the formule 


BP Ae -- om (6.47) 





Relations (6.45) and (6.47) yield formula (6.46), This proves the 
statement. 
Let p (Al) be a field differentiable at a point AJ of O. Then 


Ap = Adar + 0 (| Ar }). 


We find the matrix of a linear operator A for the case of the ortho- 
normal basis ft, 7, &. We shall assume that this basis is referred to 
a Cartesian coordinate system Oxys. 

We denote by P, Q and R the coordinates of p (4) in i, J, hk. 
Obviously by (6.46) 


=~ = 


From these formulas and from relations (6.26) for the matrix of the 
coefficients of a linear operator ini, J, 2 it follows that the matrix A 
of the operator A in question has the form 

OP oP AP 

vx oy Os 


4 =| 22 22 20 


N=) oe oy. ae (6.48) 
OR GR aR 


oz oy az 


We introduce the concept of divergence and curl of a vector field 
Pp (AM) differentiable in ©, i.e. of a field such that its increment Ap 
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at each point Af of 2 may be represented as 
Ap = AAr+o (| Ar \)s 


with A in general changing in going from point to point in Q. In 
other words, A is dependent on a point M and is of course indepen- 
dent of Ar. 

We shall call the divergence and curl of a linear operator A the diver- 
gence and curl of a field p(M) at a point M of a domain Q. Thus 
by definition 


div p = div A, curl p = curl A. (6.49) 


Remark. Under our hypotheses about the differentiability of the 

field p (MZ) in Q div p and curl p are defined at each point of . 
Since these objects are invariants (independent of the choice of 
basis), clearly div p is a scalar field and curl p is a vector field 
in Q. 
We find the expressions for the divergence, curl and directional 
derivative of a differentiable vector field p (@) assuming that in 
space an orthonormal basis 7, j, & is chosen referred to a Cartesian 
coordinate system Oxyz. We shall assume as above that p (JZ) has 
coordinates P, Q, R in i, J, k. 


Since the matrix A of a linear operator A is defined by relation 
(6.48) in the case under consideration and by definition div p = 
= div A, curl p = curl A (see (6.49)), from formulas (6.27) and 
(6.29) we get 


7 oP ta] OR 
div P= or a ae (6.50) 


curl p= (4--+) i+ (2-2 )i+(2-F) k. (6.51) 


To compute the derivative of p (7) with respect to e we use formula 
(6.46) and the properties of the linear operator. 
Let e = icosa +jcosB + kcosy*. Then by (6.46) we get 


SP = Ae= cosa Ai-+cos Aj + cosy Ak = 





a dp op op _ 
= COS @ 37 + cos Bp ay tT 008 Yor = 


= ap ap dp 
= cosa 5 -+ cos p ay 1 00s Yar 


Thus the derivative 22 can be computed either from the formula 
OP OP. Op oP 
Fer = 008 & +cos B ay 1 09S Cae rae (6.52) 


* Since e is a unit vector, its coordinates are of the form {cos a, cos B, cos y}, 
where a, B and y are the angles e makes with the Oz, Oy, and Oz axes respectively. 
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or, considering that P, Q, R are the coordinates of p (A/), from the 
formula 


0 oP _ OP “ 
L=( cosa + 5 cos B +5 cos y) i+ 
dQ rf] aQ . 
+ (Gp cosa +t cos B+ FE cos y) i+ 
aS (2 cos a} cos B-+ ais cos v) k. (6.53) 


6.2.4. Compositions of field theory operations. We shall assume 
that a scalar field u (A/) of the class C** and a vector field p (A/) of 
the class C* are given in a domain Q of a Euclidean space E°. 

Under these hypotheses gradu is a differentiable vector ficld 
in Q, div p is a differentiable scalar field and curl pis a differentiable 
vector field. Therefore the following compositions of operations are 
permissible: 

curl grad u, div grad u, grad div p, div curl] p, cur] curl p. 

We prove that 


curl gradu = 0, div curl p = 0. (6.54) 


To this end we compute curl gradu and div curl p in a Carte- 


sian system. Since in this case the coordinates of gradu are oe 


ox’ 
Ou Ou : 
Sr “ae 7 on the basis of formula (6.51) we have 


2 3 aa ; 
curl grad u= (5 atu jin (Ss atu 


Oy Oz dz dy aor tea it 
tu 6tu 
+( éz Oy —z ) 


Thus the first of the equations (6.54) is true for a Cartesian 
system. By the invariance of the expression for curl gradu, the 
first of the equations (6.54) is proved. We proceed to prove the 
second of the equations (6.54). We again turn to a Cartesian 
system. In this system rea to See a vector field curl p 
: 0 i) C7] oP 
has coordinates (5--). (<--+). (-=) , Whero 
P, Q, R are the coordinates of a vector p. According to (6.50) 
the divergence of a vector field cur] p in Cartesian coordinates 
is equal to the sum of the derivatives of the components of cur] 


* A function belongs to a class Ck in @ if all of its partial derivatives of 
order k are continuous. 
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p with respect to like coordinates. Thus 


é GR é fe] oP oR 
div ourl p= 32 (3, — 5) +a (eae) + 
a876Q oP 
+3 ($-F)=0 


The second of the equations (6.54) is thus true for a Cartesian system. 
By virtue of the invariance of the expression for div cur] p, the second 
of the equations (6.54) is true in any coordinate system. 

One of the basic composed operations of field theory is the opera- 
tion div grad u. It is briefly designated Au, the symbol A being 
usually called the Laplacian* (operator). Thus 


Au = div grad u. (6.35) 
We evaluale the Laplacian in a Cartesian system. In such a 
system a vector field grad u has coordinates = ; =, xcs . Using 
the expression (6.50) for the divergence of a vector field we get 

6*u 62u au S 

Au Set aet ae: (6.58) 


The composed operations grad div p and curl cur] p are connected 
by the relation 


curl curl p = grad div p — Ap, (6.57) 


where Ap is a vector whose coordinates in the basis i, j, & are equal 
to AP, AQ, AR (P, Q, R are the coordinates of a vector field p 
in i, j, k). The reader can easily show on his own the validity of 
relation (6.57). 


6.3, EXPRESSING BASIC FIELD THEORY OPERATIONS 
IN CURVILINEAR COORDINATES 


6.3.1. Curvilinear coordinates. Let 2 be a domain of a Euclidean 
space E%; Jet z, y, 2 be Cartesian coordinates in that space. Suppose 
further that © is a domain of a Euclidean space £? and that 21, 22, 2° 
are Cartesian coordinates in E%, 

Consider a one-to-one and bicontinuous mapping of © onto Q 
effected via the functions . 

= x (2%, 2°, 2°), y = y (at, 2, 25), 2 = 3 (cl, 2°, 2), (6.58) 


Using the above mapping we introduce in Q curvilinear coordinates 
zt, z*, 2°. The meaning of the term is easy to see from the following 


* Pierre Simon Laplace (1749-1827) is an outstanding French astronomer, 
mathematician, and physicist. 
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arguments, First, associated with each point Jf (2, y, 2) of Q ar 
three numbers x', z*, x°. More precisely, .\ is determined by a triple 
of numbers z', x*. 2°. This explains the term “coordinates” of point Mf 
for numbers z', 27, 2°. Secondly, if on the right-hand sides of rela- 
tions (6.58) any two coordinates, for example 2° and 2’, are fixed, 
then for a variable z! these relations 
define in some curve different in 
general from a straight line. It is nat- 
ural to call that curve a coordinate 
curve z', thus emphasizing that at 
the points of the curve only the co- 
ordinate z™ changes. The coordinate 
curves 27 and 27 are defined quite 
similarly. In general the coordinate 
curves w!, x*, and x*are not straight 
lines. This explains the term “eur- 
vilinear coordinates”. 

Woe have shown that there are 
three coordinate curves z', 27, 73 
Fig. 6.2 passing through each A of 2 
(Fig. 6.2). We construct ata point 
Moa basis r;, r' associated in a natural way with the coor- 
dinate curves passing through that point. In doing so we use 


: Zens " . re es ou Oz 
relations (6.58). Obviously tho derivatives ryett Fae get 


lated at a point AT are the coordinates of the tangent vector to 
zw! at that point. We denote this vector by 7,. In a similar way 
we construct the tangent vectors r, and 73 to the curves 2° and 
3 respectively. Thus, 





i 


calcu- 


Ox oy Oz are Ror 
Dak 3 nh? =r}, haz 1, 2, 3. (6.59) 


ce aa 

For the vectors r,, 72, 13 to form a basis we must require that 
they should be noncoplanar. A sufficient condition for this require- 
ment to be met is obviously the condition that the Jacobian 


Ox Oy ds 

oz? Oxt dz! 

“(z.y,2) | ax du aos 
(rt, 22, 23) ~ | dx? ax? ax? 


ox Oy Os 


— 


az% Oz dr 


should he nonvanishing, for it is equal to the triple product of the 
vectors ?y, Pa, 7s. Using the constructed basis ry, ra, Ta the conjugate 
basis r', r?, 27 is constructed in a standard way. 
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So, if curvilinear coordinates z!, x®, x? are introduced in a do- 
main Q, basis vectors r;, r? are associated with each point M of Q 
in a natural way. Consider the examples. 

1°. Cylindrical coordinate system. It is introduced with the aid 
of the relations 


L£=pcosp, y=psing, 2=4Z. (6.60) 
Thus z!'=o, 2? =@q, 2? =z. It is known that the coordinates 
P, g, 2 (or, equivalently, 2‘, x, 2°) change within the following 
limits: 


O0Oxp<t+ouo, 0S Qgo<2n, —w <Mz< ow, 


These inequalities define in a Euclidean space #® with coordinates 
P, , 2, (or zt, z*, z*) an infinite domain Q represented in Fig. 6.3. 





Fig. 6.3 


We may therefore regard the introduction of cylindrical coordinates 
in E° as a result of mapping a domain @ of £% into E® with the aid 
of formulas (6.60). 

Obviously coordinate curves p (or curves zx") are straight lines 
passing through the Oz axis perpendicularly to it, coordinate curves 
@ (curves 2x?) are circles with centres on the Oz axis, whose planes are 
parallel to the Oxy plane. Coordinate curves z (curves 2°) are straight 
lines parallel to the Oz axis (see Fig. 6.3). We find the vectors r,, 


11-01684 
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r,, f and r', r°, r°. We have 


ok { Ox oy UZ 


Se) Sey Zh =(cose, sin, 0}, 


{OZ OY Ye ogi 
= {ey og ' So} ={ posing, pcosq, 0}, 


n={S, a, =\ (0, 0, 1}. 


We stress that the expressions in the braces are the Cartesian 
coordinates of the basis vectors r;, 72, and rz. One can directly see 
that the basis 7, rg, rg is orthogonal. To calculate the conjugate 
basis we use the formulas of Section 6.1.1. We have 

cos sing 0 

Myers =| —osing p cose O}=p, 


0 0 14 
(raraf-= {pcos p, psing, GR, 
[rary] ={—sin gy, cos¢p, O}, 
[7-72] = {0, 0, p}. 
Therefore 


oi [rors] 
PyPolg 


? ={cos@, sin, 0}, 





oe Wari) _ a. : A 
mss ners ={- ; sin (p, 5 cos ep, o}, 


r= Iryre] ={0, 0, 1}. 


Ty oN9 


2°. Spherical coordinate system. It is introduced with the aid of 
the relations 


x=osin0cosq, y = p sin 0 sin wy, 2 = 9 cos 0. (6.64) 
Thus sv? =p, 2 =, 2 = 0, It is known that the coordinates 


p, ~, O (or, equivalently, zt, 2°, 2°) vary within the following 
limits: 


Ocgpct+uo,0cpc2n,0cdcKa2. (6.62) 


Inequalities (6.62) define in £° with coordinates p, q, 0 (or 2%, 

x*, 2°) an infinite domain 2 represented in Fig. 6.4. We may there- 

fore regard the introduction of spherical coordinates in 73 as a result 
° . ~ ba e . + 

of mapping the domain © of 43 into £% by means of formulas (6.64). 

Obviously, coordinate curves p (curves z!) are rays emanating 

from the origin, coordinate curves @ (curves 7?) are circles with 
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centres on the Oz axis, whose planes are paralle] to the Ozy plane, ~ 
coordinate curves 0 (curves z°) are semicircles whose centres are at 
the origin and whose planes pass through the Oz axis (see Fig. 6.4). 





We find the vectors ry, ro, 73 and r', r*, r°, We have 


r= {sin 9 cosq, sin 0, sing, cos 8}, 
={—psin® sing, psin®8 cosq, 0}, 
r,= {pcos 8 cos 9, pcos8 sing, —psin 6}. 


One can directly see that the basis r,, re, rs is orthogonal. To calcu- 
late the conjugate basis we use the formulas of Section 6.1.1. We 
have 


sin@cosm sinOsing cos 8 
ryrer; =| —psinOsin @ psin§ cos 0 |= —p*sin@, 
pcos8 cos@ pcos Osing —psin® 
[773] = {— p? sin? 0 cos p —p*sin?6 sing, —p*?sin 9 cos 6}, 
[rary] ={ psin g, pcos g, 0 }, 
[ryre] ={— cos OsinBcosg, —pcosOsinOsin ¢, psin?d fe 
Therefore 
rt =fed — {sin 6 cos 9, sin Osin y, cos 8} 
r,Por , , ? 
oiet! Al —f ising — 1 cos P 
rn ats = { p sin@’ Le “sin ? o} 
ees te | are aS ing, —-—-si 
arr ={ 7 cos 0cos @, 5 cos Osin q, 5 sin 6}. 


3°. Orthogonal curvilinear coordinate system, A curvilinear coordi- 
nate system is said to be orthogonal if so is the basis r; defined by 


4i* 
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equation (6.59) at each point of Q. The cylindrical and spherical 
coordinate systems just considered are examples of orthogonal curvi- 
linear coordinates. 

We obtain the expression for vectors ri of the conjugate basis for 
the case of the orthogonal coordinate system. 

We introduce the following notation: 


H,= |r, | He = |reh Hs = Irs | 
It is usual to call H,, H,, Hs, Lamé* coefficients or parameters. 


Since the coordinate system is orthogonal and the triple of vectors 
Ty, Ta, rs is right-handed, we have 











ryrrssMylels, (erly, ar 
Hall, _ AyHe 
ie Pay { To] a Hs M30 


Using these relations and the formulas exprossing the vectors of the 
conjugate basis in terms of vectors r; (see Section 6.1.1) we cet 


6.3.2. Expressing the gradient and directional derivative for a scalar 
field in curvilinear coordinates. Let u (1/) be a differentiable scalar 
field in a domain Q in which curvilinear coordinates z', z*, 2 
are introduced. Under these conditions grad u is defined at each 
point of Q and at each point 2 one can calculato for any direction 

: , Ou . , 5 
e a derivative =. Both the gradient grad u and the directional 
derivative at a given point Jf will be referred to the basis ry, r! 
at that point, the construction of which has been described in Sec- 
fion 6.3.1. 

1°. Expressing the gradient of a scalar field in curvilinear coordi- 
nates. After introducing in Q curvilinear coordinates z', z?, zx? the 
scalar field uw will clearly be a function of the variables z', 2°, 2: 

wees a (2) oy 2): 


This function may be regarded as a result of superposing the 
function u(z, y, s) of variables z, y, 2 and the functions (6.58). 


To calculate the derivatives therefore we may apply the 
oz 


a 4 F ay Pi du 
indirect differentiation rule. Denoting ae by u, we get 
OX 


Bu Oz ou ay Ou az 
PR a ET LG Le BR i 6.63 
ne Ox axt © ey drt ' a: azi ( ) 





* Gabriel Lamé (1795-1870) is a French mathematician. 
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: ¢ Q a ; 
Since or oe = are the coordinates of the vector grad wu in 
Sache : 
the basis i, j, & referred to the Oxyz system, and ae , = ; 

z z 


“s are the coordinates of a vector 7r;, relation (6.63) may 
U4 


obviously be rewritten in the following form: 
uy = 1; grad u. (6.64) 


Using the Gibbs formulas (see formulas (6.6) of this chapter) for 
grad u and formulas (6.64) we get 


grad u=(r, grad u) ri=uyr". 


So the gradient of a scalar field u is expressed in curvilinear coordi- 
nates as 

grad u=u,rt (u, =Z7) (6.65) 
In practice we often encounter the case of the orthogonal curvilinear 
system. In Section 6.3.1 we obtained (see Section 6.3.1.3°) an expres- 
sion for the vectors r‘ of the conjugate basis for the orthogonal 
system. Using these expressions and formula (6.65) we find the follow- 
ing formula for grad u in orthogonal coordinates: 


4 Gu 41 du 1 du 
grad Us He Gat Mab aT oat at aE ies r3. (6.66) 


An orthonormal basis e; = r;/H; is considered along with the ortho- 
gonal basis r;. It is easy to see that in e; the expression for grad u 
is of the form 
4 Ou 4 du 4 Ou 

grad be gat Ct, oat Cot Fe Gat &s- (6.67) 

2°. Expressing the derivative of a scalar field u (AL) with respect 
to a direction e in curvilinear coordinates. Let e be the contravariant 
coordinates of a unit vector e in a basis r;, so that 


e=e'r 

=> he 

In Section 6.2.2 we obtained the following formula for the 
becewge Ou 

derivative ae 

Ou 

Fe =e-grad u 


(see formula (6.40)). Substituting in this formula the expression for 
e in the basis r; and formula (6.65) for grad u we get 


ou 


So = (e*ry) (ar!) = eu, (rr!) = en 64 = We, 
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Thus the derivative of a scalar field u with respect to e can Le 
expressed in curvilinear coordinates as follows: 


—=4;c'. (6.65, 


6.3.3. Expressing divergence. cur] and directional derivative for 
a vector field in curvilinear coordinates. Let p (\/) be a differentia): 
vector field in a domain Q in which curvilinear coordinates are intra- 
duced. Under these conditions the divergence and curl of the field p 
are defined at each point of Q and at point of © one can caleu- 


Jate for any direction e a derivative . The divergence, curl and 


directional derivative at a given point Me will be referred to the basis 
ue r at that point. 

. Expressing the divergence of a sien field in curvilinear cosrdi- 
Bsr After cuvilinear coordinates z!, x are introduced in 2 
the vector field p will obviously be a fanction of the variables 
a re ees 

p=p (zt, 2°, x). 
This function may be regarded as a result of superposing the 
function p(z, y, 2) and functions (6.58). To calculate the deriva- 
op 


tives a therefore, we may apply the indirect differentiation 
Ux 


rule. Denoting “f by p,; we get 
or 


_ op oF , op oy , Gp ds of 
Pi Gr ost © oy ozt ' os azt* (6.59) 
: at oS e 
Since Ba ai, 2 aaj, 2 — = Ak, where -l is a linear operator 


defined by the caution Ap = AAr +o (jAr{) (see Section 6.2.3), 
from relations (6.69) and the properties of a linear operator we 


gel 


Ox. , OV » . Oy, 7 
pr=A (sSi+5i paler 8 k) =Ar;. (6.70) 


By definition div p = div A =r'Ar,, According to formula (6.79) 
therefore, in curvilinear coordinates the divergence of the vector 
field p (12) can be calculated from the formula 


- 2 SP. + 
div p=r'p, (= cor is (6.74) 
We find the expression for divergence for the case of the orthogonal 


curvilingar coordinate system. Using the expression for the vectors r 
of the conjugate basis for orthogonal curvilinear coordinates and 
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formula (6. we as 


ts] 
div p=—+r i Pals + aR a Polo Hr ra P3l3 (p= s5f ). (6.72) 
There is another way of writing formula (6.72). Denote by P* the 


coordinates of the field p in the orthonormal basis e=p. 

U 
Then, after a number of transformations, the expression (6.72) 
for div p takes the following form: 


A = 4 O(P!HeH3) , 0(P?H3H,) , 9.(P3H,H2) ] 
div pe A, ALA [ dxt + az? _ ax . 


(6.73) 


2°. Expressing the curl of a vector field in curvilinear coordinates. 
By definition curl p = curl A = [rtAr;]. According to formula 
(6.70) therefore we get 


curl p=[rép)) (pi=35). (6.74) 


We seek the expression for the curl in the orthogonal curvilinear 
coordinate system. Using the expression for the vectors r‘ of the 
conjugate pete for the aden geri and formula (6.74) we get . 


a 
curl p= ca (rapa + yy rapa + 7 (rsp) (Pi= er) 





(6.75) 
In the orthonormal basis e;= + the curl of p has the coordinates 
z 
{54 [ 2a) O(P3Hs) 0 (P#H2) [ 6(P1H,) (PH) 
HeHs ex? 6x3 ? 3H, oz8 éz} ? 
1 o(P%H,) a (PUH,) 
Hy Hs dat =a axt ; she (6.76) 


3°. Expressing the directional derivative of a vector field in curvi- 
ee coordinates. We use the formula 


P= Ae (6.46) 


obtained in Section 6.2.3. Let e = e’r;. Then from formula &: 46) 
and the properties of a linear operator we get 


Since Ar; = p;, where pa, for the derivative of the vector 
zt 


field p with respect to a direction e we obtain the following 


* On the right-hand side of this formula we do not sum over i. 
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expression: 
oe =e! py. (6.77) 


6.3.4. Expressing the Laplacian operator in curvilinear orthogonal 
coordinates. We have defined the Laplacian Au as a repeated opera- 
tion div grad u. Using the expressions (6.67) and (6.73) for the gra- 
dient and divergence in curvilinear orthogonal coordinates we obtain 
the expression for the Laplacian. 

In the case under consideration a vector field p whose divergence 
is to be calculated is the field grad u. Substituting (6.67) into (6.73) 
we get 





Kies { [ é (4% ou )+ 

A, HoH; ozt ff, oz* $ 
28 ( HsH, “-) 1 ¢ H,H, du a 
Y Gzt ( i, 22) * Gx ( Hz an )]. (6.78) 


6.3.5. Expressing the basic field theory operations in cylindrical 
and spherical coordinate systems. 

1°. Cylindrical coordinate system. By virtue of the results of Sec- 
tion 6.3.1.4° Lamé parameters for cylindrical coordinates are of 
the form 


A, =4, A,= po, A, =1. 


In such a case formulas (6.67), (6.73), (6.76), and (6.78) yield the 
following equations: 








ou 4 ou Gu 
grad u= ep 4 pag Os Tae ee 
46a 1 OP. OP, 
div p=—> Gp (Pp) + p og + dz ? 
4 OP, OP, , OPo OP; 
curl p= ree meer ) 7 ( dz Op Je 
; 4 8 (pP,) 1 OPp 
+(——+-— Jess 
? dp Pp oy 
1 @ gu), 1 du , au 


2°. Spherical coordinate system. In this case Lamé parameters 
are of the form 


H,=1, H,=psinO, M,= op. 
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Therefore 
i Ou 4 Ou 4 Ou 
oatu % oom eae eo 
: aP 1a 
2p @ . 
div p = a a (p°P,) + sane aa + pane “ae (Sin OP ol, 


= O(sin®Pg) apy 
curl p= psin® ( 60 ~~ a@ )ep+ 
1 9Pp 4 9(pPg) 4 A(pPe) 1 Pp 

+( psin® dp pap Je +(> dp pO ) eo, 
1 @ {2 du 
Au = or dp \P° Gp aa 

In conclusion we give a summary of formulas relating the operations: 
of taking the gradient, divergence and curl to algebraic operations: 

1°. grad (wu + v) = grad wu + grad v. 

2°. grad (u-v) =ugrad p-+v grad u. 


3°. grad (+) = 2sratu—ugrady (v 3&0). 


p2 








4 eu 


4 ie. 
“30 oe )+ p? sin? 6 dg? ° 


pe? sin 8 7 (sia 


4°. div(p+q)=div p+ divgq. 
5°. div (up) = pgrad u +u div p. 
6°. div[pg]=g curl p— peurl gq. 
. curl{p+ g]=curl p-curlq. 


8°. curl (up) = ucurl p—[p grad u}. 

It is easy for the reader to show the validity of these formulas- 
on his own. 

Concluding remarks. In this chapter we have discussed the basic 
operations of field theory. We have not relied on any physical ideas- 
since our aim was to construct a mathematical theory. In the next 
chapter we shall derive a number of important integral relations 
connecting some of the operations of field theory. These relations will 
allow us to give physical interpretation of the concepts and opera— 
tions we have introduced in the present chapter. 


CHAPTER 7 


THE FORMULAS OF GREEN, 
STOKES, AND OSTROGRADSKY 





In this chapter we obtain formulas playing an important role 
i various applications, and in particular in field theory. They 
ure in a sense extensions to the multidimensional case of the 
Newton-Liebniz formula for one-dimensional integrals. 








7.1, THE GREEN * FORMULA 


7.1.4. Statement of the main theorem. Let D be a finite, multiply 
connected in general, domain in the Ory plane with piecewise smooth 
boundary L**, The domain D with the houndary Z adjoined will 


he designated D. The following main theorem is true. 

Theorem 7.1. Let functions P (x, y) and Q(z, y) be continuous 
in D and have continuous partial derivatives of the first order in D. 
If there are improper integrals of each of the partial derivatives of the 


functions P (x, y) and Q (x, y) over the domain D***, we have 


‘J (2-4) dx dy = Pdz+Qdy, (7.1) 
L 


a relation called the Green formula. The integral on the right of (7.1) 
is the sum of the integrals along the components of Lon which a sense 
of rotation is indicated such that the domain D remains on the left. 

We shall first prove the Green formula for a special but sufficiently 
wide class of domains. We shall then establish a number of auxiliary 
statements which we shall need to prove the theorem we have stated. 

7.14.2. The proof of the Green formula for a special class of domains. 
Let D be a singly connected finite domain with piecewise smoath 


* George Green (1793-1544) 15 an English mathematician, 

** J, is said to be piecewise smooth if it is made up of a finite number of 
smooth curves. If / consists of a finite number of closed piecewise smooth curves 
Ly, then the connected domain D is usually said to he multiply connected, and 
L; are said to be connected components of the boundary L. 

*** Since the partial derivatives of P (z, y) and Q(z, v) exist only in an open 
flomain D, the integrals are improper. Under the additional assumption that the 


partial derivatives m D are continuous the integrals become proper integrals. 
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boundary L. We assume that every straight line parallel to any coor- 
dinate axis intersects Z in at most two points. Such domains will 
be called type-K domains. 

Under the hypothesis there are improper integrals of partial deri- 
vatives of P (x, y) and Q (x, y). This means that for any system 





Fig. 7.1 


of domains {D,} monotonically exhausting D we have for example 


La i) 2 oe dy = \j 22 ae dy 


(similar relations are true also for other partial derivatives of P (x, y) 
and Q (2, y)). 

We describe how to construct a special system of domains {D,} 
monotonically exhausting a type-& domain. We shall need it in 
proving the Green formula for those domains. 

Let a closed interval {a, b] on the Ox axis he the projection of D 
onto that axis. Draw through the points a and b straight lines parallel 
to the Oy axis. Hither of the two lines intersects the boundary L 
in one point only. The two points A and B of intersection of the 
lines with Z (Fig. 7.4) divide Z into two curves LZ’ and L” which 
are obviously the graphs of the continuous functions y, (x) and 
Yo (x) piecewise differentiable on [a, 6], respectively. Note (Fig. 7.4) 
that y, (t) < ye (x) (equality holding only for s = a and x = b). 

Next consider a sequence of closed intervals [a,, b,} such that 
a<a, <b, <b, a, a, b, +b as n -> oo. In addition suppose 
that for any n an interval [a,, b,] is contained in [a,4,, Dp +4]. 
Choose a number e, > 0 so that the graphs LZ, and Li, of the func- 
tions y, (v) + &, and y, (x) — e, are in D and do not intersect. 
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The boundary of D, is a curve made up of the curves Lj, and L; 
and the segments of the vertical straight lines passing through the 
points a, and b, (Fig. 7.1). The domain D,., is constructed in 
a similar way, but instead of the interval [a,, b,,) we take an interval 
la@n=3, bn 4,] and choose a numbere,+; > O less than the number c.. 
It is obvions that if ¢, +0, then the constructed system of domains 
{D,} monotonically exhausts the domain D. . 

We prove the following statement. 

Theorem 7.2. Let functions P (z, y) and Q (x, y) satisfy in a type-K 
domain D the hypotheses of Theorem 7.7. Then for that domain and 
for the functions P (x, y) and Q(z, y) the Green formula is valid. 

Proof. It suffices to show the validity of the equations 


\ ae dz dy =e Qdy, — \ de dy = b P dz. (7.2) 


Since the proofs for these are of the same type, we shall prove only 
the second of the equations. 
Consider the double integral 


( dz dy. (7.3) 


we 


Dn 
For D, and the integrand Sein (7.3) all the conditions hold under 


which the repeated integration formula is valid. From this formula 
we have 
bn V3(x)-tn 


¥ oP oP 

Nap teGi= | de | ade 

Dn an wi(x)t+en 
on bn 

= | Plz, v.(2)—en) dz—{ P(x, us (z)+en) a2. (7.4) 
en an 


The left-hand side of relations (7.4) as n—» oo has a limit equal 
to [| + azay. By uniform continuity of P(z, y) in D, each of 


“p 
the terms on the right of (7.4) has as n-roo a limit equal to 
( P (z, y2(x)) dz for the first term and to | P (xz, yy (z)) dz for the 


a ed 
second. The former integral, with the direction of circulation 
about the boundary as indicated in Fig. 7.4, is the line integral 


Piz, ujdz 


ee 
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ant nature, its form and value remain unaltered under a transition to 
a new Cartesian system. Indeed, under such a transformation of 
coordinates the absolute value of the Jacobian transformation 
is equal] to unity. According to the remark, however, the integrand 
changes neither form nor value. 

Now consider the integral 


bP dz+Q dy (7.7) 
L 


on the right of the Green formula. We show that this integral has 
also an invariant nature, its form and valueremaining unaltered under 
a transition to a new Cartesian system. 

Let ¢ he the unit tangent vector at the points of Z whose direc- 
tion agrers with the direction of circulation about L, and let cosa 
and sina be the coordinates of ¢. Choose as a parameter on & an 
arc Jength J, the increase in / agreeing on each connected component 
of the boundary with the direction of circulation about that compo- 
nent. Under the conditions on L the function ¢ (1) will be piecewise 
continuous. Under the conditions formulated above the vector field p 
is continuous on Z and its coordinates P and Q are continuous func- 
tions of 1. 

Notice that once the sense of rotation and the parameter of L 
are chosen the line integral of the second kind (7.7) is transformed 
into a line integral of the first kind. P and @ are calculated at the 
points of ZL and dz = cosadl, dy = sing dl. Thus 


§ Pdz+Qdy =$ (Poosa+Qsing)dl=4 ptdl. (7.8) 
i L E 
Relation (7.8) shows that the integral (7.7) has indeed an invariant 
nature: the scalar product pf is an invariant, and parametrization 
with the aid of arc Jength is independent of the coordinate system. 
Moreover, in the new Cartesian system Oz'y' 

pt dl = (P' cosa’ + Q' sing’) dl = P’ dz’ + Q' dy’, 
and therefore 

P dz + Q dy = P’ dz’ + @’ dy’. 
So we have shown that the integral (7.7) has an invariant nature, 
its form and value remain unaltered under a transition to a new 
Cartesian system. P 


The above reasoning allows the Green formula (7.1) lo assume 
the following invariant form 


kcurl pdo = pt dl, (7.9) 
\f $ 
BL L 


where do is an area element of D. 
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Remark 2. The integral 
§ ptdl 
is 


is usually called the circulation of a vector field p about a curve L. 

From Theorem 7.2 and the conclusions of this subsection we may 
draw an important corollary. 

Corollary. Let functions P (x, y) and 
Q (x, y) satisfy the hypotheses of Theorem 7.1 
in a finite domain D with piecewise smooth 
boundary L. If D can be divided into a finite 
number of domains D, with piecewise smooth 
boundaries Ly, (Fig. 7.2) each D;, being a 
type-K domain with respect to some Cartesian 
system, then for D and for P (x, y) and 
Q (x, y) the Green formula is valid. 

The validity of the corollary follows from 
the following arguments. It is clear that the Fig. 7.2 
Green formula is valid for each of the do- 
mains D,. This follows from the invariance of the formula and from: 


Theorem 7.2 (in some coordinate system D,, is a type-K sea 


It is also obvious that the sum of the integrals [ [ (<= _ 





D, 
3) de dy on the left-hand sides of the Green formulas over 
00 ~=«aP 


the domains D, is if (-a) dx dy. But the sum of the line 
“D 


integrals b Pdz+Qdy on the right-hand sides of the Green 
Ly 
formulas along the boundaries L,, of D, gives § Pax+Qdy, for 


L 
the integrals along the common parts of the boundary of the 
domains D, cancel out, these parts being traced in opposite 
directions in adjacent domains D, (consider Fig. 7.2 for expla- 
nation). 

Remark 3. An arbitrary finite connected domain D with piecewise: 
smooth boundary Z cannot in general be divided into a finite number 
of domains D,, of the type indicated above. From every finite domain 
D with piecewise smooth boundary, however, we can remove an 
arbitrarily small part such that the remaining domain can be divided 
in the necessary way. Contributions to the right- and left-hand sides. 
of the Green formula corresponding to the removed part of D will 
accordingly be arbitrarily small. This idea is the basis of the proof 
for the Green formula in the general case. 


ww 
“tl 
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In Section 7.1.4 we shall prove a number of auxiliary proposi- 
tions using which we shall establish the Green formula in the general 
case in the way indicated above. 

7.41.4. Auxiliary propositions. Let L be a piecewise smooth plane 
curve without self-intersections on which the arc length J is chosen 
as the parameter. 

A neighbourhood of an interior point P on L is any connected open 
set of points of Z not coinciding with the whole of the curve Z and 

= p containing the point P. For an end point oj L 

A we introduce the concept of half-neighbourhood.* 

- The length of a neighbourhood (or half-neigh- 
= bourhood) is called its extent. 

An interior point P of L divides cach of its 
neighbourhoods into two half-neighbourhoods. 
A neighbourhood of P is said to be a d-neigh- 
bourhood if either of the half-neighbourhoods 
is of length 2. 

Lemma 1. Let L be a smooth finite curve 
Fig. 7.3 without self-intersections, let A and B be the end 


points of the curve, and let L be a connected part 


-of L consisting together with its end poinis A and B entirely of interior 
points of L (Pig. 7.3)**, We can find two positive numbers }. and § 
such that the supremum. of the angles which the tangents at the points 
of the }-neighbourhood of any point P of L*** makewith the tangent 
al P is less than x!8 and the distances from P to the points of L outside 
the i-neighbourhood are less than &****, 

Proof. We show that we can find > 0 satisfying the hypotheses 
of the Zemma. First, we note that given any a > 0 we can find for 
every point P a d-neighbourhood (4 > 0) such that within it the 
supremum of the angles the tangents at the points of that A-neigh- 
bourhood make with the tangent at the point P is less than a. 
‘This follows from the continuity of tangents to the curve L. 

The question is whether there is a universal 7 suitable for all 
points of the curve ZL. 

Assume that there is no % > 0 satisfying the hypotheses of the 
lomma. Then given any 4, = 1/n on Z we can find points P, and 





* If P isan end point of £ and @ is any of its other points, then the set of all 
‘points of L between P and Q including P but not Q is said to be a half-netyh- 
hourhoad of P. = 

**® The curve may be closed. In this case L may coincide with J. If Lisa 
-closed curve with one corner point, then L is any closed connected part of f 
net containing that corner point. - 

*e* A neighbourhood of a point of ZL is considered to be a neighbourhood 
of that point on L. 
-see8 Obviously 4 >> 6. 
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Q, such that the length of the arc P,Q, is less than 4, and the angle be- 
tween the tangents at those points is at least equal toa fixeda< n/8. 
We select a subsequence {P,,} of {P,} converging to a point P of L. 
Obviously {Q,,} also converges to P. Consider the A-neighbourhood 
of P in which the supremum of the angles between the tangonts at 
the points of the neighbourhood and at P is Jess than «/2. 

It is clear that the angle between the tangents at any two points 
of that 4-neighbourhood of P is less than ¢. With rn, sufficiently 
large, the points P,, and Qn, will be in the chosen A-neighbourhood 
of P and therefore the angle betwoon the tangents at those points 
must be less than a whereas by the choice of the points it must be 
greater or equal to «. This contradicts our assumption that thero 
is no 4 > 0 satisfying the hypotheses of the lemma. Note that the 
required A is less than cither of the arcs AA or BB. 

Now we prove that we can find 5 > 0 satisfying the hypotheses of 
the lemma. 

Assume that there is no 6 > 0 satisfying the hypotheses of the 
lemma, Then given any §, = 1/n we can find a point P, on LZ and 
a point Q, on ZL such that the longth of the arc P,Q, is equal to or 
greater than 2.* whereas the chord P,Q, is of length smallor than 6,. 
We select a subsequence of {P,} converging to a point P of Land 
consider the corresponding subsequence of {@,}. We select a subse- 
quence {Q,,} of that last subsequence converging to the point Q of L. 
It is clear that {P,,,} converges to P, Since by the choice of the points 
P,, and Qn, the length of the arc P,,Qn, is equal to or greater than A, 
so is the length of the arc PQ. Since the lengths of the chords P,,Qn, 
tend to zero, the length of the chord PQ is zero, i.c. the point P 
coincides with @ and is therefore a point of self-intersection of the 
curve Z without self-intersections. This contradiction supports the 
possibility of choosing the required 5 > 0. The proof of the Iemma 
is complete. cS 

Corollary 1. Let the curves L and L satisfy the hypotheses of 
Lemma 1. Then we can find a number 2A such that any are of L 
of length smaller than 2A is 1-1 projected onto one of the coordinate 
axes of a fixed Cartesian system Oxy. 

Indeed, take as 4 the number indicated in Lemma 1. Any arc 
of Z of length smaller than 2 4 is contained in a 4-neighbourhood 
of some point P on L. The tangent at P makes with the Oz or Oy 
axis an angle equal to or less than 7/4. Then clearly the tangent at 
any point of the arc under consideration makes with that axis an 
angle less than n/2 and therefore the arc is 1-1 projected onto the 


* That such a A exists has been established in the first part of the proof. 
12-01684 


178 Fundamentels of Mathematical Analysts 


axis (were it not 4-1 projected there would be tangents making 
with the axis an angle equal to =7/2). 
Corollary 2. Let the curves Land L satisfy the hypotheses of Lemma. 


Then we can find a number 23.>>0 such that any are of L of length 

smaller than 23. is 1-1 projected onto both coordinate axes of a Cartesian 

system Oxy especially chosen for that are. _ 
Take as 2 the number indicated in the lemma. Any arc of LZ less 


o 


than 2 7% is contained ina %-neighhourhood of some point P of L. 
Choose a Cartesian system so that the tangent at P makes with 
the coordinate axes an angle 2/4. Then the tangent at any point 
of the arc will make with either of the Oz and Oy axes an angle less 
than 2/2 and therefore the arc will be 4-4 projected onto cither of 
the axes. Note that slight changes in the coordinate system chosen 
do not affect the possibility of the arc being 1-1 projected onto 
both coordinate axes. 

Lemma 2. Let Q be a square, and let R be an angle with vertex 
at the centre P of the square Q and with opening 2a < xn/4. Denote 
by T the part of the boundary of Q contained in R. Then the angle be- 
tween any chord of the curve Y (the straight line joining tuo points of T) 
and the bisectriz of R is at least a. 

In view of the elementary nature of the Jemma we leave it unproved. 

Lemma 3. Let Q be a square and let L be a smooth curve without self- 
intersections emanating from ihe centre P of Q. Also suppose that the 
supremum of the angles the tangents to L make with the halj-tangent 


to L at P is equal toa<(x/8. Then L intersects the boundary of Q 
tn at most one point. 

Proof. Construct an angle Ff of opening 2e, 2a < 2a << n/4 whose 
bisectrix is the half-tangent to Z at P and whose vertex is the centro 
P of the square. Denote by P the part of the boundary of Q contained 
in R. Obviously LZ is inside R (if L did not intersect a side of R 
at a point other than P, then there would be a tangent parallel} te 
that side and the tangent would make with the half-tangent to 
L at P an angle equal to a > a, which contradicts the hypothesis). 
Let L intersect T in two points Af and N. Then on L we could find 
a point the tangent at which would be parallel to the chord A/V 
and according to Lemma 3 that tangent would make with the half- 
tangent to Z at P an angle at least equal io a > @ and this contra- 
dicts the hypothesis. The proof of the Jemma is complete. 

Corollary of Lemmas land 3. Let Land L satisfu the hypotheses 
of Lemma 1 and let 6 > 0 be the number indicated in that lemma. 
Then L intersects the boundary of any square Q with cenire at an arb- 
ilrary point P and with side of less that 26 in at most two points, 

We shal] demonstrate the validity of the corollary. Let P be an 
arbitrary point of Z and let ~2>>0 he the number indicated in 
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Lemma 1. Consider a A-neighbourhood of P. Both end points of the 


neighbourhood and the part of £ outside the )-neighbourhood are 
according to Lemma 4 outside any square with centre at P and of 


side less than / 28. Therefore the 4-neighbourhood under considera- 
tion (and only that neighbourhood) intersects the boundary of Q*. 
Since either of the half-neighbourhoods of the A-neighbourhood of 
P under consideration satisfies the 
hypotheses of Lemma 3, it isclear y] 
that the A-neighbourhood intersects 
the boundary of Q in at most two 
points. 

7.1.5. Special subdivision of a 
domain D with piecewise smooth 
boundary L. Let D be a multiply 
connected domain whose boundary 
LZ consists of a finite number of 
closed piecewise smooth curves, 
P,, P., ..., Py being the corner 
points of L. We assume a Cartesian 
system Oxy to be chosen in the 
plane. 

We shall show a method of spe- 
cial subdivision of D into subdom- 
ains. We shall need such subdivisions in proving Theorem 7.1. 

1°. We show that for any « > Owe can choose the squares Q;, Qo, ... 
..-, Qy with centres at the corner points of Z and with sides parallel 
to the Ox and Oy axes (Fig. 7.4) so that the following conditions hold: 

(1) The boundary of any square Q; with centre at P; intersects 
either of the two branches of Z emanating from P}* in exactly one 
point (see Fig. 7.4). Those points are the only points the boundary 
of a square Q; has in common with that of L. 

(2) The sum of the areas of Q; is less than e; the sum of the lengths 


of the parts of Z that are in the squares Q; is also less than e. The 


sum of the perimeters of the squares Q; clearly is not greater than 
Ae, where A is some constant. 

The possibility of the above choice of the squares Q; arises from 
the following arguments. 

Consider the A-neighbourhoods of corner points subject to the 
requirements: 

4. These A-neighbourhoods do not intersect. 





Fig. 7.4 


* Here we are using the Jordan theorem which states that if two points of 
a continuous curve L are an interior and an exterior point of a domain D then L 
intersects the boundary of D. 

** A sufficiently small A-neighbourhood of a corner point P; consists of two 
smooth branches emanating from that point. 


12% 
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2. The sum of the lengths of all 4-neighbourhoods is less than ¢. 

3. The supremum of the angles the tangents of cither of the half- 
neighbourhoods of a 4-neighbourhood made with the corresponding 
half-tangent at a corner point is less than @ << 2/8. The possibility 
of the choice of such A-neighbourhoods of corner points is obvious. 
Note that either of the half-neighbourhoods of the 2-neighbourhoods 
chosen satisfies the hypotheses of Lemma 3. Therefore eithor of these 
half-neighbourhoods intersects in at most one point the boundary 
of any square with centre at the corresponding corner point. 

For every corner point P, we define a number 6, > 0 equal to 
tho infimum of the distances from P; to the part of Z obtained by 
romoving from L a d-neighbourhood of the point Py,. 

We denote 5 = min {8,, 5,, ..., Sy}. It is clear that any square 
Q; with centre“at P, the length of whose side is less than 2 6 satis- 
fies tho above condition (1) for, with the choice of square Q, indicated, 
the hypotheses of Lemma 4 hold for either of the half-neighbourhoods 
of the point P; and, in addition, the end points of the half-neigh- 
bourhood are outside the square Q, (this ensures the uniqueness of 
the point ofintersection of the half-neighbourhood with the boundary 
of the square). It is also clear that by making smaller the sides of 
the squares we can “make the sum of their areas become loss than e. 
Obviously, the sum of the lengths of the parts of Z that aro in the 
squares Q, will be less than e owing to a special choice of 2-neigh- 
bourhoods of the corner points. Thus condition (2) also holds when 
Q; are chosen as indicated. 

2°. We remove from LZ those parts which are in the squares Q;. 
The remaining part of Z is a collection of smooth curves LE, without 
common points, some of Z, boing smooth closed curves. Note that 
every open curve ZL; consists of interior points of a smooth curve LZ, 
whose end points are the corner points of Z (see Fig. 7.4). 

For each of the curves LZ, we use Lemma 1 of tho preceding sub- 


section. Let 4; and Sf be numbers guaranteed for LZ; by that lemma. 
We make 5f obey yet another requirement, that 5f should be less 
than the infimum of the distances from the points of Z, to the other 
curves Z,. Further denote 4°= min {%4, day. 2+) Ay} and O< 
<6" < min {6f, 53, ..., S54}, 6% < 12 5, where 6 is the num- 
ber chosen in 1°. Obviously % > 6*. 

We divide cach curve Z; into a finite number of parts of length 
less than §*. We construct squares Q; whose centres are at division 
points of the curve £,, with sides of length 6* parallel to the Oz 
and Oy axes. 


3°. Using squares Q, and Q; we construct the required subdivision 
of the domain D. 
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(1) Remove from D the parts D and the squares Q; have in com- 
mon. The remaining part of D is designated D, and the boundary 


of D, is designated Z,. The boundary L, consists of curves TL; and 
the line segments parallel to the coordi- 
nate axes. 3 y 

(2) Denote by Q; the part a square Q; 
and the domain’ D, have in common. The 
domains Q; divide the domain D, into sin- a 
gly connected parts D7, the boundary of 
each consisting of line segments parallel to 
the coordinate axes and of possibly one 
curvilinear segment contained in one of the 


curves L; and having alengthsmallerthan 6. ~0| % 


Since that curvilinear segment is 1-4 projec- 

ted onto one of the coordinate axes (the Fig. 7.5 

length of each of such segments is less 

than 6* <4 and in this case according to Corollary’ 1 of Lemma 1 


it is 1-4 projected onto one of the coordinate axes), any domain D, 
clearly can be divided with straight lines parallel to one of the coord- 
inate axes into a finite number of parts D;, each a rectangle or a cur- 
vilinear trapezoid** possibly degenerated into curvilinear triangle. 

Figure 7.5, shows sa domain D;, the dotted lines indicating a sub- 
division of D; into parts D,. 

7.1.6. Proof of theorem 7.1. We have just seen that after removing 
from D the parts that are in squares Q; we obtain a domain Dt** 
with boundary £, which can be divided into a finite number of 
domains D, of specia] kind. 

We prove that the Green formula is true for D,. According to the 
corollary of Section 7.1.3, to do this it is sufficient to show that each 
of D, is a type-K domain with respect to some specially chosen 
Cartesian system. 

If D, is a rectangle, then the required system is for example a coor- 
dinate system one of whose axes is parallel to a diagonal of the rect- 
angle. Let D; be a curvilinear trapezoid or, a curvilinear triangle. 
From the way D,, are constructed it follows that the curved side of 


* A domain D is said to be singly connected if any piecewise smooth, not 
self-intersecting closed curve in D bounds a domain all points of which are in D. 
** Recall that a curvilinear trapezoid is a figure whose bases are parallel 
to one of the coordinate axes, one of whose lateral sides is parallel to the other 
coordinate axis and the curved lateral ide is 1-1 projected onto that axis. 
*** Recall that Q; arechosen for any given pose & so that the sum of their 
areas is less than ¢ and the sum of the lengths of the parts of the boundary Z 


a are in Q; is also less than e. It is clear that as e > 0 the domains D, exhaust 
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the bonndary of D, satisfies the hypotheses of Lemma f in Section 
7.4.4 and therefore, according to Corollary 2 of the lemma, is 1-1 
projected onto both coordinate axes of a specially chosen Cartesian 
system. Since slight changes in the chosen system do not violate 
the indicated property, we may clearly choose a coordinate systom 
such that the rectilinear parts of the boundary of D,, aro also 1-4 
projected onto its hoth axes. With respect to that system D, is 
a type-A domain. So for D, the Green formula 


( (2-SE)dzay=h Paz+Qay ain 
Me ie 


is true. From the way domains D, are constructed it follows that 
as e—O the Ieft- and right-hand sides of formula (7.10) have 


respectively the limits ( ( ( a i ) dzdy and | Pdr+Qdy 
“D L 


The proof of Theorem 7.1 is complete. 


7.2, THE STOKES ° FORMULA 


7.2.4. Statement of the main theorem. Let S be a bounded complete 
piecewise smooth two-sided surface with piecewiso smooth boundary 
pee 

A neighbourhood of S is any open set Q containing S. 

The following main theorem is true. 

Theorem 7.3. Let functions P (x, y, 2), Q (x, y, c) and R (z, y, 2) 
be continuous and have continuous partial derivatives of the first order 
in some neighbourhood of a surface S. Then the following relation holds 


IV (S---2) ay ac+ 


+(- seis =) dz dz+-(32—3) dedy = 
= Pdz+-Qdy+Radz (7.14) 
P 


called the Stokes formula, The integral on the right-hand stde is a 
sum of integrals along the connected components of Y on which a direc- 
tion of circulation is indicated such that with regard to the choice of 
surface side the surface S remains on the left. 

Using Romark 2 of Section 5.3.2 on the form of notation for sur- 
face integrals of the second kind and symbols X, Y, Z for tho angles 





* George Gabriel Stokes (4819-1903) is a well-known English physicist 
and mathematician. 
** Note that a closed surface has no boundary. 
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the normal to the surface forms with the coordinate axes we can 
rewrite the Stokes formula (7.11) as follows: 


{{(B-)eoox + (B—2owr + 


+ (32-3) cosz ]do= § Pdc+ Qdy+ Raz. (7.12) 
r 


In the subsections that follow we shall prove a number of proposi- 
tions we shall need to prove the stated theorem. 

7.2.2. The proof of the Stokes formula for a smooth surface 1-1 pro- 
jected onto three coordinate planes. The following theorem is true. 

Theorem 7.4, Let S be a bounded complete smooth two-sided singly 
connected surface with piecewise smooth boundary I. We assume S 
to be 1-4 projected onto each of the coordinate planes of a system Oxyz. 
Let P, Q, and R be functions given in some neighbourhood of S, con- 
tinuous in that neighbourhood and having in it continuous partial 
derivatives of the first order. Then the Stokes formula (7.11) is valid. 

Proof. To prove the theorem we turn to the form (7.12) of writing 
the Stokes formula. We shall assume the unit normal vectors to 
form acute angles with the coordinate axes. 

Obviously the theorem will be proved if we prove the equations 


\ | (+ —“s cos ¥— i ee Bc } 
8 


\j (<5 ae. cos Z—22 cos X} do ~§ 04 { (7.43) 





§ J (> an £2 cos XE cos ¥ ) do == Gnas 
R 


Since relations (7.13) yield themselves to proofs of the same type, 
we shall prove only the first of them. 

We denote by J the integral on the left of the first of the equations 
(7.13): 


I= \j (= cos y-> cos Z do. (7.14) 


Under the hypothesis the surface S is smooth and 41-1 projected 
onto the Oxy plane. Therefore S is the graph of the differentiable 
function z = z (z, y). In this case, with regard to the orientation 
of the unit normals to S, cos Y and cos Z can be found from the 
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formulas 


i. >, (7.15) 


cos Y = J ——=—=—_=== 
VWi-tp—q * Wi-p?-g 


as 


az 
where p=—>, q=7,. 
Using formulas (7.15) relation (7.14) may be rewritten as 
follows: 


ia =) (24 95~) cos Zao. (7.16) 


Since on S the values of P (z, y, 2) are equal to P (zy y, = (z, Y)), 
by the indirect differentiation rule 
a ap, "oP 
ay [PG yale INS Geta ae 


Therefore relation (7.16) becomes 


I=— \ * [P(z, y, (x, y))] cos Z do. (7.47) 


Let D be the projection onto the Ozy plane of the surface S 
and let Z be the projection onto that plane of the boundary T° 
of S. Obviously the surface integral on the right of (7.17) is equal 


to the double integral \ ( x [P (z, y, 2(x, y))] dx dy (see Remark 2 


oe 


D 
in Section 5.3.2) and therefore 


a i a IP (a, y, 2 (a, y))) dxdy. (7.18) 


Applying to the integral on the right of (7.48) the Green formula 
we get 


{l= [P (x, y, 2(z, y))Jdxdy= —} P (az, y, (2, y)) dz. (7.19) 
» L 


Suppose a point Af (z, y, z) of I is projected into the point 
N (x, y) of the curve ZL. Then clearly the value of the function 
P (z, y, 2) at the point AY of I coincides with the value of P (x, y, 
3 (z, y)) at the point N of Z. Therefore 


G Plz, yw 2 (2, y)\idz =  P (z, y, 2) dz. (7.20) 
Li r 


Obviously relations (7.14), (7.48) to (7.20) yield the first of the 
equations (7.43). The second and third of these equations are proved 
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similarly, but it is necessary to consider the projections of S onto 
the Oyz and Ozz planes respectively. The proof of the theorem is 
complete. 

7.2.3. The invariant form of the Stokes formula. Let functions 
P(x, y, 2), Q(z, y, 2), and R(z, y, z) be continuous and have 
continuous partial derivatives of the first order in some neighbourhood 
Q of a surface S. We define in Q a vector field p whose coordinates 
in a given Cartesian system are equal to P, Q, R. Obviously, under 
the conditions imposed on the functions P, Q, R the fild p is con- 
tinuous and differentiable in Q. We find the curl of p. Using the expres- 
sion for curl p in the orthonormal basis i, j, k we get 


_ (aR ag aR\:.,/(0Q aP 
curl p= (4--£) i4( —=)i+(¢-> ay <—) ke (7.21) 
We choose on S a definite side, i.e. indicate on S a continuous field 
of unit normals mw. Turning to the expression (7.24) for curl p and 


using the standard notation cos X, cos Y, cos Z for the coordinates 
of the unit normal vector n to S we get 


neurl p= (—— Sk 22 =) cos X + ( ~ 32) cos Y+ 
: +(2-4) cos Z, (7.22) 


It follows from relation (7.22) that the integral on the left of the 
Stokes formula (7.42) may be written as 


i neurl p do. (7.23) 


So once a definite side of the surface is chosen the integral on the 
left side of formula (7.42) may be regarded as the surface integral 
of the first kind (7.23) of the function nm curl p given on S. Since 
the scalar product p curl p and the area element do of S are indep- 
endent of the choice of Cartesian system in space, under a change 
to a new orthonormal basis i’, j’, &’ the left-hand side of formula 
(7.42) remains unaltered in form and value, i.e. it is invariant 
under a choice of Cartesian system in space. 
Now consider the integral 


§ Pac+Qady+ Raz (7.24) 
Tv 


on the right of the Stokes formula. 

We show that this integral also has: an invariant nature, its form 
and value remain unaffected under a transformation to a new Carte- 
sian system. 
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Let ¢ be a unit tangent vector at the points of the boundary I 
of S whose direction agrees with the direction of circulation about I, 
and Iet cos a cos fi, cos y be the coordinates of ¢. Choose the arc 
length / to be the parameter of I, increases in the parameter on 
each connected component of © agreeing with the direction of circula- 
tion about that component. Under the conditions imposed on I 
the function ¢ (l) is piecewise continuous. Since p is continuous 
on [, its coordinates are continuous functions of 2 on T. Note that 
once the direction of circulation and the parameter on [ are chosen 
the line integral of the second kind (7.24) transforms into a line 
integral of tho first kind, with P, Q and A calculated at the points of 
T and dz = cosadl, dy = cos fi dl, dz = cosy dl. Thus 


§ Pdz+Qdy+Rds= 

tr 

=§ (Pcosa+Qcosh+ Rceos»y) di= f ptdl, (7.25) 
r Pr 


Relations (7.25) show that the integral (7.24) has indeed an invariant 

nature: the scalar product pé is an invariant, parametrization with 

the aid of the arc length is independent of the coordinate system. 
In the new coordinate system Ozx'y’z’ we have 


pt dl=(P' cosa’ + Q’ cosBf + Ri cosy’) dl = Pl dz! + 
+Q' dyf + Rods". 
Therefore 
Pdz+Qdy+Rdz = P’ dz’ +- Q' dy’ + R' dz’. 
Note that the integral 


§ pedi 
Tr 


is usually called the circulation of a vector field p about the curve I. 
The above reasoning allows the Stokes formula (7.41) (or (7.12)) 
to assume the following invariant form: 


\ j neourlip do = 6 ptdl. (7.26) 
“s r 


7.2.4. Proof of Theorem 7.3. We prove the following auxiliary 
statement. 

Lemma. Let S be a bounded complete two-sided smooth surface 
with piecewise smooth boundary T*, There is § > 0 such that any con- 


* Note that a closed surface haz no boundary. 
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nected part of S whose size is less than 5* is 1-4, projected onto each 
of the coordinate planes of some Cartesian system. 

Proof. We first show that some neighbourhood of each point Af 
of such a surface is 1-1 projected onto each of the coordinate planes 
of some Cartesian system. 

Let mz be a unit normal vector to the surface at 7. Choose a Carte- 
sian system Oxyz so that msg makes acute angles with the Oz, Oy, 
and Oz axes. Then in that coordinate system the determinants } 


Yu 2y Ty Yu 
Yo 29 Zy Yo 


are clearly nonzero for the values of u and v determining the point M, 
and by the smoothness of S they are nonzero in some neighbourhood 
of the point (wu, v) (these determinants are proportional to the coord- 
inates of the unit normal vector to the surface). Turning to the proof 
of Theorem 5.1 and to the remark to the theorem (see Section 5.1.2) 
wesee that some neighbourhood of the point is 1-1 projected onto 
each of the coordinate planes of the chosen coordinate system Ozxyz. 

Assume that the statement of the lemma is false. Then for every 
6, =1i/n, n =1, 2, ... we can find a part S, of S whose size 
is less than 6, and which is not 1-1 projected onto the three coord- 
inate planes of any Cartesian system. Choose in every part S, a point 
M,, aud then choose a subsequence of the sequence {/,} converging 
to some point M of S. Consider the neighbourhood of M that is 
4-1 projected onto each of the coordinate planes of some Cartesian 
system Oxyz. The neighbourhood contains one of the parts S, that 
is also 1-4 projected onto the three coordinate planes of the system 
Ozyz. But this contradicts the choice of parts S,. Thus the assump- 
tion that the statement of the lemma is false leads to contradiction. 
This proves the lemma. 

Now we proceed to prove Theorem 7.3. Divide S with piecewise 
smooth curves into a finite number of smooth parts S;, each of the 
size less than 5 indicated in the lemma we have just proved. Add to 
the curves dividing S the edges of the surface. Since S; is 1-1 projected 
onto the three coordinate planes of some Cartesian system, by the 
invariance of the Stokes formula (see Section 7.2.3) and the conclu- 
sions of Section 7.2.2 the Stokes formula is true for a part S;. Now 
sum the left- and right-hand sides of the Stokes formula for the parts 
S;. Obviously the sum of the left-hand sides of the formulas is the 


double integral j \ n curl p do and the right-hand side is the sum 
8 


Zy Ly 


2 














. 
Zp Xp 








of the integrals 0 pt dl along the boundaries I, of S;. It is clear 
v; 


* Such a part of the surface may be in a sphere of radius 6, 
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that the integrals along the common parts of the boundaries of 
S;, cance] out for they are traced in opposite directions (consider 
Fig. 7.6 for explanation). Therefore the above sum of line integrals 





is equal to the line integral along the boundary I of the surface S. 
Our reasoning implies the validity of the formula 


Ss 


2 


\ [e a dl 


which is‘just the Stokes formula. The proof of the theorem iscomplcte 


7.3. THE OSTROGRADSKY FORMULA 


7.3.1. Statement of the main theorem. Let V be a finite, in general, 
multiply connected, domain with piecewise smooth boundary S* 
in the Oxyz space. The domain V with adjoined boundary will] be 
designated V. The following main theorem is true. 

Theorem 7.5. Let functions P (x, y, 2), Q (x, y, 2), and R (x, y, =) 
be continuous in V and have continuous partial derivatives of the first 
order in V. If there are improper integrals of each oj the partial deriva- 
tives of P, Q, and R over V, we have the relation 


Vj (++) dz dy dz= 


= ( ( Pdydz+-Qdzdz+Rdzdy (7.27) 
“s 


* The boundary S is said to be piecewise smooth if it is made up of a finite 
number of smooth surfaces adjoining one another along smooth curves, the 
surface edges. If S consists of a finite number of closed piecewise smooth sur- 
faces S;, then S; are said to be connected components of § and the connected do- 
main V is said to be multiply connected. 
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known as the Ostrogradsky formula. The integral on the right of it is 
the sum of the integrals along the connected components of S on which 
the side exterior to V is chosen. 

We confine ourselves to proving the Ostrogradsky formula for 
only a special class of domains. 

Note that Theorem 7.5 can be proved by extending the method 
used in Section 7.4 to prove the Green formula. 

7.3.2. The proof of the Ostrogradsky formula for a special class of 
domains. A singly connected finite domain V is said to be a type- K 
domain if every straight line parallel 
to any coordinate axis intersects the 
boundary S of Vin at most two points. 

For the type-K domain special sys- 
tems of exhaustive domains {V,} are 
used. We now describe how such sys- 
tems are constructed. 

Let a domain D in the Oxy plane be 
the projection of a domain V onto that 
plane. Draw through the boundary 
points of D straight lines parallel to 
the Oz axis. Each of the straight lines 
intersects the boundary S of Vin one 
point only. The set of these points divi- 
des S into two parts, S’ and 8S”, : 
(Fig. 7.7) that are the graphs of the Fig. 7.7 
functions z, (x, y) and 2, (x, y) conti- 
nuous in D and piecewise differentiable in D. Note that z, (z, y)< 
<2» (x, y) (equality holding only at the points of the boundary of D). 

Consider an arbitrary sequence of domains {D,} monotonically 
exhausting D. Let 5; and S%, be the graphs of the functions z, (z, y) -+ 
+, and 2, (z, y) — & given on D, (€, is chosen to be so small 
that the surfaces S, and Sz, do not intersect). ‘ 

The boundary of V,, is the surface made up of the surfaces S;, 
and S; and part of a cylinder with generators parallel to the Oz 


axis, the boundary of a domain D,, serving as the directrix of the 
cylinder. The domain Vi+1 is constructed similarly, but instead 
of D, we take the domain 0,4, and choose €,4, to be less than ep. 
It is obvious that as €, —0 the system {V,} monotonically exhausts 
the domain V. 

We prove the following statement. 

Theorem 7.6. In a type-K domain V, let functions P (x, y, 2), 
Q(z, y, 2), and R (z, y, 2) satisfy the hypotheses of Theorem 7.5. 
Then for that domain and for the functions P, Q, and R the Ostrogradsky 
formula is valid. 
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Proof. Clearly it suffices to show the validity of the equations 


{| { LP dx dydz=\ | Padyaz, 


e 2s ol ewe 


| 2 dedyds= | | Qdzar, (7.28) 


oy 


iy 
{ SBacayar= \J Rdzdy. 
s 


Since their proofs are of the same type we prove the third equation. 
Consider the triple integral 


\ \ { Sf ae dy ds. (7.29) 
Vn 


For the domain V, and for the integrand 0R/ézin the integral (7.29} 
al] the conditions hold under which the repeated integration for-~ 
mula is valid. From this formula we have 

Z3(=_ N)—En 


([{acdya= [fara | Bare 


Yn ‘Dn 2(x, ven 

= (J R(x, Y, 2(Z, y)—&n) dx dy— 
a 

—{ { R (z, Yy 2 (z, y)+e,)) dz dy. (7.30) 
Dn 


The Jeft-hand side of relation (7.30) as nO has a limit equal 


to (\ [ St ae dy dz. By the uniform continuity of the function 
e a o! a 
R(x, y, 2) in the closed domain V cach of the terms on the right 
of (7.30) has as n-~oo a limit equal to ( [ R(x, Y,22(z,y)) dz dy 
‘yD 
for the first term and to ( ( R(z, y, (x, y)) dx dy for the second. 


D 
The former of the integrals is (if the exterior side of § is chosen) 


the integral ( [ R(x, y, 2) dz dy and the latter (taking into account 
“*s- 


the “ininus” sign preceding it) is the integral \ ( Riz, y, 2) dzdy. 


Ss’ 
So the right-hand side of relations (7.30) has as n~,r oo a limit 
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equal to ({ aq, y, 2)dxdy. Consequently the third of the for- 


s 
mulas (7.28) is proved. 

The first and the second formulas (7.28) are proved similarly (it 
is necessary to consider the projections of V onto the Oyz and Ozz 
planes respectively and repeat the reasoning). The proof of the theorem 
is complete. 

7.3.3. The invariant form of the Ostrogradsky formula. Let func- 
tions P, Q, and R satisfy the hypotheses of Theorem 7.5 in a finite 
connected domain V with piecewise smooth boundary S. We define 
in V a vector field p whose coordinates in a given Cartesian system 
Ozxyz are equal to P, Q, R. Under the conditions imposed on these 


functions the field p is clearly continuous in V and differentiable 
in V. 

We find the divergence of p. Using the expression for the diverg- 
ence of p in an orthonormal! basis i, j, ki we get 


FaQ_ 


div’ p= ar a 


Remark. We transform to a new Cartesian system in space. 
Let i’, 7’, k’ be an orthonormal basis referred to that system and 
let P’, Q’, R’ be the coordinates of p in that basis. Obviously the 
functions P’, Q’, R’ are continuous in V and differentiable in V 
(they are linear combinations of the functions P, Q, R). 

Since in the new caenae system 

2 oe, 
div p = a fe + + me 


‘ 


by oe invariance 
aQ’ 
tse C4 aS w+. 


Thus, if P, Q, R are ponedece ae ane coordinates of the vector 
field p, the expression +2 By Se a remains unaltered in both 


form and value under a i rongormalion to a new Cartesian system, 
i.e. is an invariant. 

We may therefore make the following important conclusion: 
the integral on the left of the Ostrogradsky formula (7.27) has an invar- 
iant nature, tis form and value remaining unaltered under a iransforma- 
tion to a new Cartesian system. Indeed, under such a transformation 
of coordinates the absolute value of the Jacobian is equal to unity. 
But according to the remark the integrand remains unaffected in 
both form and value under a transformation of coordinates. 
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We now look at the integral 
[J Pdydz+-Qdzdz+Rdzdy (7.31) 
“Ss 


on the right of the Ostrogradsky formula (7.27). We shall show that 
the integral also has an invariant nature, its form and the value of 
the integrand remaining unaffected under a transformation to a new 
Cartesian system. 

Using Remark 2 of Section 5.3.2 on the notation of the surface 
integral of the second kind and symbols X, Y, Z for, the angles 
the normal n to the surface forms with the coordinate axes we may 
rewrite the integral (7.31) as 


( ( (PcosX+Qcos ¥Y + Roos Z) do, (7.32) 
‘ 


The integrand in the integral (7.32) is a scalar product xp and the 
integral (7.32) (or equivalently the integral (7.31)) may therefore 
be written in the following invariant form: 


\J npdc, 


Note that this last integral is generally called the flux of the vector 
field p through the surface S 

Turning to the invariant notation of the integral (7.34) we sce 
that in the new Cartesian system the integral has the form 


[ j P' dy! ds'-+Q' dz dx’ + Ri dz’ dy’. 
“Ss 


Our arguments here allow the Ostrogradsky formula (7.31) to 
be written in the following invariant form: 


\ \ \ div pdu = { \ npdo, (7.33) 
v s 


where dv denotes the volume clement of V. 

From Theorem 7.6 and conclusions of this subsection we may draw 
an important corollary. 

Corollary. Let functions P (z, y, 2), Q(z, y, 2), and R (zx, y, 2) 
satisfy the hypotheses of Theorem 7.5 ina finite domain V with piecewise 
smooth boundary S. If V may be divided into a finite number of domains 
V,, with piecewise smooth boundaries S;,, each of V;, a type-K domain 
referred to some Cartesian system, then for V and P, Q, and R the 
Ostrogradshy formula is true. 

The validity of the corollary is obvious from the following 
reasoning. It is clear that the Ostrogradsky formula is true for 
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each of the domains V;. This follows from the invariant nature 
of the formula and from Theorem 7.6 (in some coordinate system V; 
is a type-K domain). Poreier it is obvious that the sum of the 


integrals IN (= e448 Sie ot) de dy dz from the left-hand sides 


h 
of the inte ae formulas for the domains V, is the integral 
{ \j (= an +2 C4 a 2) ax dy dz. But the sum of the surface inte- 


grals \ j P dy dz+Qdzdr+ Rdzdy on the right-hand sides of the 
s 


k 
Ostrogradsky formulas along the boundaries S, of V; gives 
j j Pdydz+Qdzdz+ Rdzdy, for the integrals along the common 


parts of the boundaries of V, cance] out, the parts in adjacent 
domains V, being opposite in orientation. 


7.4. SOME APPLICATIONS OF THE FORMULAS OF GREEN, 
STOKES AND OSTROGRADSKY 


7.4.1. Expressing the area of a plane domain aS a line integral. 
Let D be a finite plane connected domain with piecewise smooth 
boundary L. The following statement is true. 

The area o of D may be calculated from the formula 


soy edy—y dx (7.84) 


where the line integral is a sum of integrals along the connected com- 
ponents of L, a direction of circulation being indicated on each of the 
components such that D remains on the left. 

To prove the statement, consider in D the functions 

P(z,y)=—y, Q(2, y) ==. 

These clearly satisfy in D all conditions under which the Green 
formula (7.1) is true. From this formula we have 

7] 0 
JN (GPA?) deav=§ (— doo) ay, 
D 


The double integral in the last eas equals 2o and the line integral 
equals bz dy — y dx. Thus formula (7.34) is proved. 


L 
7.4.2. Expressing volume as a surface integral. Let V be a finite 

connected domain in space with piecewise smooth boundary S. 
The following statement is true. - 
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The volume v of V can be calculated from the formula 


—— ( y xdydz+ydzsdz+-sdzdy (7.35) 


oe 


in which the surface integral is a sum of integrals along the connected 
components of S, the side exterior to V being chosen on cach of the com- 
ponents. 

To prove the statement, consider in V the functions 


P(@,y,ct)=2, QO, y,2)=y, R(x, y, 5) = 2. 


These clearly satisfy the conditions under which the Ostrogradsky 
formula is true. By this formula 


ae ( 29 +7) 4 4) dz dy dz= 
v 


ar oy 





_ j ( zdydz+ydsdxz+<2dzxdy. 


The triple integra] in the Jast formula equals 3v. Therefore the Jast 
formula implies relation (7.35). This proves the statement. 

7.4.3. Conditions under which the differential form P (a2, y) dz +- 
+ Q(z, y) dy isa total differential. Here we show a number of con- 
ditions under which the differentiable form P (x, y) dz + Q(z, y) dy 
given in the connected domain D is a total differential of some func- 
tion u (z, y). 

We prove the following theorem. 

Theorem 7.7. Let functions P (x, y) and Q(z, y) be continuous 
in a domain D. Then the following three conditions are equivalent. 

41. For any closed (possibly self-intersecting) piecewise smooth curve 
L in D 


4 Pdz+-Qady=0. 
L 


2. For any two points A and B of D the value of the integral 
{ Paz+Qdy 


AB 
is independent of the piecewise smooth curve AB joining the points 
A and B and lying in D. 

3. The differential form P (x, y) dz +- Q (x, y) dy is a total dtffer- 
ential. In other words, a function u (Af) = u (z, y) is given in D 
such that 


du = P dx + Q dy. (7.36) 
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In this case, for any points A and B in D and for an arbitrary piece- 
wise smooth curve AB joining those points and lying in D 


\ P dz+-Q dy =u(B)—u{A). (7.37) 
s : 
Thus, fulfilling each of conditions 1, 2, 3 is necessary and sufficient 


for either of the other two to be fulfilled. 
Proof. We prove the theorem using the diagram, i.e. prove that 


C) 


the first condition implies the second, the second implies the third, 
and the third implies the first. It is obvious that this will prove the 
equivalence of conditions 1, 2, 3. 

First step: 1 +2. Let A and B be arbitrary fixed points in D, 


and let ACB and AC'B be any two piecewise smooth curves joining 
those points and lying in D (Fig. 7.8). The sum 


of the curves is a piecewise smooth (possibly ? 
self-intersecting) closed curve ZL = ACB + ys . 
BC’'A in D. Since condition 1 is assumed fulfil- 
led, we have 4 

§ Pdx-+Qdy=0. Fig. 7.8 

3 


~~ — 
From this, considering that ZL = ACB + BC'A and that under 
a change of the direction of circulation the line integral changes. 
sign, we get the relation 


( Pdz+Qdy= Pdr+Qdy. 
ACB ACB 
Consequently condition 2 holds. 
Second step: 2 +3. Let Af, be a fixed point, let Af (z, y) be an 


—" 
arbitrary point of D, and let AJ,J7 be any piecewise smooth curve 
in D joining the points M7, and Af. 
By condition 2 the expression 
u(M)= j Pdz+Qdy (7.38) 
Mit 
13% 
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is independent of Jd and is therefore a function given in D. 
We prove that at cach point AJ of D there are partial derivatives 


Ou ou r 
y i Ts and ty? with 
ou du 
ar =P@y, sae y) 


(7.39) 


Since P (x, y) and Q (z, y) are conti- 
nuous in D, tho last relations imply 

0} x the differontiability of u and equation 

Fig. 7.9 (7.36). This will prove the second step, 
2 +3. 

The existence of partial derivatives off u (z, y) is proved simul- 
taneously with equations (7.39). We prove, for instance, the existence 
of du/dz and the first of the equations (7.39). Choose a point Jf (x, y). 
Assign tojthe independent variable z an increment Az small enough 
for the serment ALN joining Jf (xz, y) and NV (« + Az, y) to lie 
in D* (Fig. 7.9). We have 


Aucsu(z-+-Az, y)~u(z, y)= 
\ Pdz-+-Qdy— ( Pdzr+Qdy= \ Pdzx+Qdy. 


— — 
MouMN MoM 


On JIN the value of y is constant and therefore \ Q dy = 0. Con- 


MN 
sequently 
x+Ax 
Au = [ Pdz= ( P(t, y) dt. 
a x 


Applying to the last integral the mean value theorem we get 
Au = P (x + 0Az, y) Az, where 0 <0 <4, 
whence 


AC = P(r4-0Az, y), 0<0<14, 
rf 

By the continuity of P(z, y) the right-hand*side of the last 
equation has a limit as Az-»0 equal to the value of this function 
at Af (zx, y). Consequently, the left-hand sido too has the same 
limit equal by definition to =~ . The existence of a partial deriv- 

* Since D is a domain, i.c. a set consisting of interior points only, such a 
choice of Ar is possible. 
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ative and the validity of the first of the equations (7.39) are 


thus proved. The existence of a partial derivative = and the 


validity of the second of the equations (7.39) are proved 
similarly. 

We now prove relation (7.37). Let A and B be any points in D, and 
let AB be an arbitrary piecewise smooth curve joining these points 
and lying in D. The curve is defined by the parametric equations 
z=x(t), y=y(t),ax<ti<b. Using the rule for evaluating 
line integrals we get 

b 
| Pav+Qdy= | {P(x(), yl) 2" (H+ Ole), YM) yO) dt= 


~ a 


AB 


Lad 


= | uidt=u(z(b), (6) —u(e(a), y (a) =u(B)—n(A). 


Formula (7.37) is thus proved. 

Third step: 3 +4. This statement follows from formula (7.37). 
Indeed, for a closed curve Z the end points coincide and therefore 
by formula (7.37) 


$ Pde+Qdy=u(A)—u(A)=0. 
L 
The proof of the theorem is complete. 


Remark. We noted that conditions 1, 2, 3 of Theorem 7.7 are 
equivalent and therefore, in particular, condition 3 is a necessary 


and sufficient condition under which the line integral | P dz + Q dy 


be, 


is independent of the choice of curve LZ joining any given points 
A and B in a domain D. 

For singly connected domains* we shall show a necessary and suf- 
ficient condition, convenient for applications, that the differential 
form P dr + Q dy should be a total differential of some function. 


Naturally this condition is necessary and sufficient for [ Pdz+ 


L 
+@Qdy to be independent of the choice of curve LZ joining any 
given points A and B in D. 

Theorem 7.8. Let functions P(z, y) and Q(z, y) and their deriv- 
atives be continuous in a singly connected domain D. Then each 


~e= 


of the three conditions 1, 2,3 of Theorem 7.7 is equivalent to 


* Recall that a domain D is said to be singly connected if any piecewise 
smooth, not self-intersecting, closed curve in D bounds a domain all of whose 
points are in D. 
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condition 
oP ao, 
4, —= — inD. 
ou Ox 


Proof. We use the diagram 
I 
io 
ae 


We have already proved the statements 1+ 2—-3. Now we prove 
that 34 and 4—1. 
First step: 34, Let there exist a function u(z, vy) in D such 


du ou 
= a4. —= _—_= 
that du= P dz+Qady. Then jar =P, 7 Q 
oP 8 (08) 8 (IH) 10 
dy ay \ oz] ax \ dy ]~ ar ° 


Thus condition 4 holds. Note that proving the step 3 +4 does 
not require D to be singly connected. 

Second step: 4-1. Let condition 4 
hold. Then at each point of D 


—=0. (7.40) 


If ZL is a closed piecewise smooth 
curve without self-intersection lying in D 
and bounding a domain D* (D is singly 

Fig. 7.10 connected and therefore each point of 
D* is in D), then applying the Green 
formula to D* and using (7.40) we get 


§Pa +Qdy= [ [ (<0 - =) ardy=o. 
L 





az ay 


ee 


D* 
When ZL has a finite number of points of self-intersection or is 
a broken line with a finite number of components, b Pdxz+Qdy=0 


c 
for each loop Z of L and therefore bP dz4+-Qdy=0 for L. 


L 

Let Z be an arbitrary closed piecewise smooth curve, Choose for L 
a number 2, > 0 in the way indicated in Lemma 1. Divide Z into 
components L,, of length less than 4 (the corner points of 4 are also 
among the division points, see Fig. 7.10). According to Lemma ! 
the tangents at the end points 3/7, and .V,, of each of the components 
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L, make an angle less than x/8. Then obviously for a sufficiently 
small 4 the curvilinear triangle M,N;C), (the shaded triangle in 
Fig. 7.10), in which 4,C, makes with the tangent at J, an angle 
less than n/8 and N,C,, is the normal to L at Ny, is entirely in D 
and is a closed piecewise smooth curve without self-intersections. 
Therefore 


Pdz+Qdy=0. 
MzN},Cp 


It follows that the line integral along the arc M,N n is equal to 
the line integral along the broken line M,,C,N,: 


[ Pdz+Qdy= | Pdr+Qady. 
ah My,C;,Np 

Similarly for any component LZ; we obtain in D a closed broken 
line ZL for which 


§ Pdz+Qdy=§ Pdz+Qady. (7.41) 
Zz L 


We noted above that for a closed broken line Z in D the integral 
\p dx + Q@ dy =0. From this and from (7.44) we get 
“ 


§ Pdx+@ dy =0. 
i 


The proof of the theorem is complete. 

7.4.4. Potential and solenoidal vector fields. Earlier (see Sec- 
tions 7.1.3, 7.2.3, and 7.3.3) we introduced the concepts of circula- 
tion and flux of a vector field. We recall these notions. 

Let a continuous vector field p (/7) = p(s, y, z) be given in 
some domain D. 

Definition 1. The circulation of a vector field p about a closed piece- 
wise smooth curve L lying in D is the integral 


$ ptdl, 
L 


where t is a unit tangent vector to L and dl is the differential of the 
are length of L. 
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Definition 2. The flux of a vector field p through an oriented piece- 
wise smooth surface S in D is the integral 


\ | pr do, 


le 


Ss 


where n is a unit normal vector to S indicating the orientation of S 
and do is the area element of S. 

We introduce the concepts of potential and solenoidal vector fields. 

Definition 3. A vector field p is said io be potential in D if,the circu- 
lation of the field about any closed piecewise smooth curve in D is cero. 

Definition 4. A vector field p is said to be solenoidal in D if the 
flux of p through any piecewise smooth, not self-intersecting closed 
surface in D that is the boundary of some bounded subdomain of D is 
zero. 

For continuous differentiable vector fields and a special class 
of domains we shall prove a theorem containing necessary and suffi- 
cient conditions for a field to be potential. 

As a preliminary we shall introduce the concept of three-dimensional 
singly-connected-surface domain or SCS domain. 

A three-dimensional domain D is said to be a singly-connected- 
surface domain (or SCS domain) if for any piecewise smooth closed 
curve Z in D we can find an orientable piecewise smooth surface 
S in D such that its boundary is Z. Note that for that surface S$ 
the Stokes formula is true. 

The following theorem holds. 

Theorem 7.9. Let a continuously differentiable vector field p = 
= {P, Q, R} be given in a SCS domain D. Then the following three 
conditions are equivalent: 

4. The vector field p = p (MM) is potential. 

2. In D there is a potential function u (AM), i.e. a function such that 
p = grad u or equivalently 


du= Pdz+Qdy+Rdz. 


In this case for any points A and B in D and for an arbitrary piecewise 
smooth curve AB joining these points and lying in D 


[ pt di=u(b)—u(A), 


~— 


AB 

where tis a unit tangent vector to AB and dl is the differential of an arc. 
3. The vector field p = p (M) is irrotational, i.e. curl p = 0 in D. 
Condition 3 is obviously equivalent to the relations 


oP _ OQ 20 _ aR OR _ 
ay oz? Os oy’ on dz” 
Either of conditions 2 and 3 is thus a necessary and suffictent condi- 
tion for the differentiable vector field p to be potential. 
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Proof. We use the diagram 


C) 


The statements 1-2 and 2-»>3 are true without assuming D 
to be a SCS domain and their proofs are quite similar to those of 
the corresponding statements of Theorems 7.7 and 7.8. 

We prove the statement 3 14. 

Let Z be a piecewise smooth closed curve in D. Under the hypothe- 
sis D is a SCS domain. There is therefore a piecewise smooth surface 
S in D such that its boundary is Z. By the Stokes formula (7.26) 


c 
ons \J neourl pdo. 


From this and from the condition curl p = 0 we get 
§ ptdl=0, 


L 
i.e. the field p is potential. The proof of the theorem is complete. 

In conclusion we prove the theorem on necessary and sufficient 
conditions for a vector field in the so-called singly-connected-volume 
domains (or SCV domains) to be solenoidal. A spatial domain D 
is said to be a singly-connected-volume domain or SCV domain if 
any piecewise smooth, not self-intersecting closed orientable surface 
in D is the boundary of a domain that is also in D. 

Theorem 7.10. For a continuously differentiable vector field p 
to be solenoidal in a SCV domain D it is necessary and sufficient that 
at every point of D 

div p = 0. 

Proof. (1) Necessity. Let Af be an arbitrary point of D. Consider 
any sphere § with centre at Af lying entirely in D. Applying to the 
ball Dg with boundary S the Ostrogradsky formula (7.33) we get 


[ j ( div p dv= ( npdo. (7.42) 

De “s 

Since the field p is solenoidal, { J np do =0 and therefore by (7.42) 
“s 


( ( \ div p dv = 0. Applying to the last integral the mean value 


theorem we see that at some point of Ds div p = 0. By virtue of 
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the arbitrariness of the ball and the continuity of the field p this 
implies that div p vanishes at AJ. The necessity of the hypotheses 
‘of the theorem is thus proved. 

(2) Sufficiency. Let S be any closed, piecewise smooth, not self- 
intersecting, orientable surface in D. Since D is a SCV domain, S is 
the boundary of the domain Dg that is also in D. Applying to Ds 
and to p the Ostrogradsky formula (7.33) we obtain the relation 


( [ npdo=0. 


woe 


‘Since S is an arbitrary piecewise smooth, not self-intersecting closed 
orientable surface in D, the last equation implies by definition that 
the field p is solenoidal in D. The proof of the theorem is complete. 


SUPPLEMENT 
DIFFERENTIAL FORMS IN EUCLIDEAN SPACE 


78.1, Skew-Symmetric Multilinear Forms 


7S.A4. Linear forms. Let V he an arbitrary n-dimensional vector space whose 
‘elements are designated &, y, .... We shall study functions associating with 
each element —£ € V some real number. 

Definition 1. A function a (&) ts said to be a linear form tf for any &€ V,; 
mE Vand any real number + 

(1) a (§ + m= a (8) +a (n), 

(2) a (2.8) = ha (8). 

Definition 2. A sum of two linear forms a and b is a linear form assoctating 
ucith each vector BE Vo a number 

e (&) = a (8) 4- b (8). 

A product of a linear form a by a real number 7 is a linear form b assoctating 
with each rector &€ Vo a number 

b (3) = ha (®). 

The set of all linear forms thus forms a vector space which we designate 
L, (V)*. We find the representation of the linear form ain some basis {e;}Piy- 
Let 


where the numbers 2! are determined uniquely. Denoting a, = a (¢;), the desired 
tepresentation has the form 
uy 
. Te 
a(&)= \’ Stay. 
it 


* The space L(V) is also designated V* and called conjugate (or dual) to V. 
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78.1.3. Multilinear forms. Let p bea natural number. We use VP = VOX Vx 
vo... % Vito denote the set of all ordered collections (2), $2, . . -. $;.) of p vor- 
tors, each lying in V, and consider the functions associating with cach of such 
collectians some real number. 

Definition. A functton a (8\. Sy... +. Sp) is said to be a multilinear form of 
degree p (or p-form) if it is a Unear form in each of the independent variables with 
the valucs of the rest fixed. 

Introducing linear operations into the set of all p-forms we obtain a linear 
space which we designate L,, (1). 

We find the representation of an arbitrary multilinear form a (3,. $2, . . «. Ep) 
in some basis {e)}f., of V. We denote 


Visto tp TOC Cyr ees e%,) 


n 
Hence if & = “he, k= 4, 2, ..., py then 
i=! 
a 1 iret i 
a(E1, Sa, eee) Ep)= age Tia. viper ss" tee ae 


ij=t ip=t 
Tf e® (€) is a basis in ZL (V) conjugate to {e¢,}, then obviously the p-forms 
Tr : oe ings 
OPE Ey, Say wees Ep) eet Ry) ef? He). &? Er) 
form a basis in Ly (V) and thus Ly, (1) is of dimension np. 


75.1.4. Skew-symmetric multilincar forms. 

Definition. A multilinear form a (8, Ga,-. +, Ep) is said to be skew-symmetric 
if under a permutation of any two (ndependent variables tt changes sign®. In other 
words 


ee e 3 - ‘2 te La - J 
@ (S11 Saree or Sis ee oe Sjrccies 5p) == 0 (St, Say ee os Sfreees gi. coe Spe 


Obviously, a set of all multilinear skew-symmetric forms of degree p form 
a subspace of Ly (1) which we designate Ay (V)**. The elements of A, (V) are 
designated w = w (8), &:, . . «+ Sp). 

Notice that if {e;} is an arbitrary basis in V and 


n n 

o= SN... SM a, eh... ety 
—_ — deeetp p’ 
iy={ {p=1 


then the numbers wj,4...3, change sign under a permutation of two indices. This 
follows from the fact that 


Oise HO CC ees Ci) 


It is natural to consider that A, (V) = L, (V) and that A (1) consists of 
all constants, i.e. coincides with the number line. 

78.1.5. External product of skew-symmetric forms. Consider two skew-gym- 
metric forms oP € Ap (V) and 9 € lg (V). We introduce here a basic operation 
in the theory of skew-symmetric forms, the operation of external multiplication, 





* Skew-symmetric multilinear forms are also called antisymrnetric, skew, oF 
exterior. 
** This space is also designated APV* and called the pth exterior degree of *. 
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Let 


@P=OP (Nr, Nay -+-> NP)» TWEV, 
T= 01 (Er, Soy wey Eqhs SHEVe 
Consider the following multilinear form a = Dp.q (V): 


@ (1, oy ooeg Epeq) =P (5, woes Ep)-o4 (pen oeey Bpeg) (7.43) 
This in general is not skew-symmetric. That is, under a permutation of &; 
and §, where !< i<p and p+1<j<p-+4q, the form (7.43) may not 
change sign. It is this that necessitates the introduction of external product. 
' To introduce external product we shall need some facts from permutation 
theory. 
Recall that a permutation of numbers {1, 2,.. ., m} is the function o = o (h) 
defined on these numbers and mapping them in a one-to-one manner onto itself. 
The set of all such permutations is designed De Obviously there are in all m! 


different permutations in 5),,. For two permutations o € > hi and té Die 


a superposition ot € pe is uniquely defined. The permutation‘c~ is the inverse 
of ojif 0-1 = ao-1 = «, where ¢ is an identity permutation (i.e. e& (k) = k, 
k= 41,2,...,m). 

A permutation a is said to he a transposition if it interchanges two numbers, 
leaving the others fixed. In other words, there is a pair of numbers ¢ and j/ 
(<igm 1<j<m, ix jf) such that o (i) = j, o (j) = i, and o (kh) =k 
for k s£ i and k = j. Clearly, if o is a transposition, then o-? = o and o-o = e. 

It is known that any permutation o can be represented as a superposition of 
transpositions interchanging adjacent numbers, the parity of the number of 
transpositions in such a decomposition being independent of the choice of de- 
composition and is called the parity of the permutation o. 

We introduce the following notation: 

1, if o is even, 

sgn o={ —{, if o is odd. 

Notice that a form a € Ly (V) belongs to “Ap (V) if for any ‘permutation 
o€Np 

@ (So1)s Sote)) ++ +9 Sa(p)) =S0G-a (Er) Ber «++ Sp)- 

Consider again the multilinear form (7.43). For any permutation o €f bas es 
we set 

Oa (Ey, «0+, Bp4g) = 2 (Sats), - +++ Sol P4q))e (7.44) 

It is easily seen that if t € Dp +q and o€ ye then (tc) a = t (ca). 


We introduce the following definition. 
Definition. The external product of a form oP € Ap (V) and a form wI€ Ag (V) 
is a form © € Apyq(V) defined by the equation 


OE, -++1 Bpeg)= >) SBR 9-02, (7.45) 

G 
where the sum is taken over all permutations o € Dy ptq satisfying the condition 
oij)<o()<...<a(p), o(p+i)<-.--<o(p+aq) (7.46) 


and the value of oa is given by equations (7.43) and aa) 
The external product of w? and 9 is designate 


o= oP A oF 
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By way of illustration, consider the action of a permutation o sati-fving 
condition (7.46). Suppose two columns of vehicles are moving in parallel along 
some road, the first column consisting of p vehicles and the second of g vehicles. 
After some time the read becomes narrower and the two columns rearrange inte 
one column without stopping. The vehicles of the first column occupy places 
somewhere among the canoe: of the second, but the sequence of vehicles within 
either column remains the same. As a result, we obtain a permutation saticfying 
condition (7.46). It is easy to see that, conversely, any such permutation can be 
realized in our model. 

To see that our definition is correct it is necessary te prove that m = 
= oP A wT € Anz, (V). Clearly it is only necessary to prove the antisymmetry 
of the form ow. 

We show that under a permutation of two independent variables =; and Ey44 
the form @ changes sign. It will then easily follow that w € Anag (VW) Let 


TE are be such a permutation. We shall see that 
TW) = —® = (sgn T) Oo. (7.47) 
From (7.45) we get 


to = N) (sgna)-(t0) a. 
ie 


We split this sum into two: 


to = NV (sgn a) (ta) a-}- SY” (sgn 9) (t0) a. (7.48) 
G a 


The first sum wil) contain those permutations o for which either o7! (i) < p 


a7 (6+ 1) <a p or oF (i) Spt i, oF (6 +1) > p44. For cach of such 
permutations 


(to) a = —oa, 


To make this statement clearer, we denote k = o7! (i), b=: ott (f+ 1), ie. 
t= oa (k),i-+- 1 =o (J). The form oa isa product of wm? and wo, the independent 
variables of w? being the vectors 00), Ea(a)s « - +s Sap): and of w@ the vectors 
Sopa) +) Socpeqy TES pandl < p, then &; = Ean) and E24 = So¢y) are 
the ladenendent variables of the form cw? which is skew-symmetric as stated. 
Consequently, interchanging & and €;4, makes oP and hence oa change sign. 
The case where k S p -- 1 and 1 > p -# 1 is considered along the same lines. 

So for the first sum we have 


Ay (sgn a) (to)a= — SY (sgn 6) ga. (7.49) 
6 o 


The second sum will contain those permutations o for which cither o-! (i) <7 p, 
ot (it 1) Spt i or of () Sp tdi, ot (i+ I) Sp. We show that ihe 
set of permutations {0} satisfying this condition (and of course condition (7.46) 
as we)}) coincides with the set of permutations of the form to, where o € fo). 
Let us turn to our two-column model. The statement will assume the following 
obvious form. 

Tf under any rearrangement a vehicle k of the first column finds itself directly 
in front of a vehicle Zof the second column, then we can easily find another rear- 
rangement as a result of which those vehicles would interchange places, the 
sequence of the other vehicles remaining unaltered. 

Thus, since sgn ta = —sena 


N’" (sgno) (ta)a== — N’” (sgn ta) (10) a=: — NV" (egn a) oa.! (7.54) 
o a g 
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Substituting (7.49) and (7.50) in (7.48) we obtain (7.47). 
Example 1. Consider tuo linear forms # (€) € A, (¥) and ¢ (2) € A; (VY). 
The external product is the bilinear form 


i A e= S (sgno)-of (&) g (Eo) =f (Ex) & (Eo) —e (E1) f Ee) 
\o 
Example 2. Let f (§) € A; (J 
product @ = fA gisaq- I-fo 
So. Sir + +s Sq 


), & ir Ee. -- +> Eg) € Ag (V). The external 
rm. whos i dependent varjables we denote by 


o= y (sgn o) of (Eo) g (Ey, Sor eees E= 


oT 
q 
eS) (=I) F (EN 2 Gon a9 Biya Btege <3 oe. Ep) 


78.1.6. Properties of external product of skew-symmetric forms. (1) An 
obvious property of external product is linearity: ; 

(a) if oP € Ap (V), w%€ Ay (V). then for any real number 7. 

(.@P) A of = oP f\ (409) = 7% (ow? fA, 0%); 

(b) if oP € Ap (VY), @2 € Ap (V) and w%€ A, (V), then 

(oP FaP) A ot=o? A 09-4 of A 0%. 

(2) Anticommutativity. If oP € Ap (V) and of € 4g (T), then 

OP A of=(—1)P9 oF A oP. 

Proof. Let 

oP \ O1=O= (§1, En, -.., Sp4q)- 
It is easy to see that 

O71 A OP=O (Epays Spar. «++ Epays Err -e2> Ep) 
We show that the permutation Ep+i, .--, ptq: 1: - + -» Sp) may be obtained’ 
from the vectors (61, - . -, Sp+g) by means of pg successive transpositions. The 
vector §p4; may be moved To the first pire using p transpositions. Using the 
same number of transpositions we may then move to the second place the vector 
€p4., and so on. In all, we shall move p vectors, using p transpositions each time, 
i.e. the number of all transpositions is pg. In this case anticommutativity is 


implied by the antisymmetry of the external product. 
(3) Associativity. If oP € Ap (V), 2 E Ag(V), @7 € 4, (¥), then 


(oP A oF A oF = oP A (o% A 07). 


N : 
Proof.t Let 6 € > p:qgsr0 Consider 
‘al ~ < ce < . < 
o= > (sgn G) o[@P (Ey, ..-5 Ep) 9 (Spay, ---y Sp4q) OF (Epages- -- +1 Spager))- 
C 


(7.54): 

The sum (7.51) equals (o? A %) (A o* if we first sum over all permutations- 
that leave unaltered the numbers p+-q-+i, p+q+2, ..., pater 
and satisfy condition (7.46) and then sum over all permutations that preserve 
the resulting order of the first p +- q independent variables and the order of the- 


variables Spsoga.- + ++ Sptqt¢r 
Similarly we can obtain” oP A (of A oF). 
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We show that in both cases we obtain a sum over all permutations satisfying 
the conditions 


o(i)<o(2)<...<9(p), 


O(p+1)<o(p+2)<...<0(p+q), (7.52) 


o(pte-i)<...<o(ptg+r). 


To do this we turn again to our vehicle-column model. Suppose there are 
three columns of vehicles moving along the road, p vehicles in one, q in another, 
and r in the third. One of the ways to rearrange the three columns into one is to 
first meree the first and the second column and then join the resulting column to 
the third. Alternatively, the second and third columns may first be merged and 
the first joined to them. Obviously the permutation o resulting from either of 
these rearrangenients satisfies condition (7.52) and conversely cither permutation 
satisfying condition (7.52) may be obtained using cither the first or the second 
way of rearranging the vehicles, This just means that (@? A w% Ao? and 
aP A (wt A wt) coincide. 

ane associativity of external product enabJes one {o consider any finite 
product 


@, A OA... A Om, where 1 € Ap, (V). 


Exampe 1. Let ay (§), @2 (8), - + «1 @m (8) be linear forms. Then 


ay A az A... A am= XS’ (sgn 0) 6 {a (Ey) a3 (Es) «+. am (Sm)), (7.53) 
Co 
where the summation is taken over all permutations o € = m 


The equation is easy to verify by induction. Notice that if we introduce the 
matrix {a; (€))}, then equation (7.53) may he rearranged in the form 


(a, A az A eee Atm) (Sir Sao ones Sm) = aet (a; (§))}. (7.54) 


~ - te: ° a 
78.1.7. Basis in space of skew-symmetric forms, Choose some basis tet 
in a space V and denote by {ci)P_, the conjugate hasis in ZL (V). Recall that 
e1 (8) is a Jinea. form which on the elements of the basis {e,} takes the value 


ei ) = 1j- - . 
n Section 78.1.3 we showed that all possible products 


(54) #8 (Ba)... oP Ep) 


form a basis in Ly (V). Since Ap (VY) & Ly (VY), every skew-symmetric p-form 
P. A py Pp i 4 

may he decomposed uniquely as a linear combination of those products. How- 
ever, they form no basis in Ay (V), since they are not skew-symmetric p-forms, 
i.e. do not belong to A p (V). Nevertheless we can construct from them a basis in 
Ap (V) using external multiplication. 

Theorem 7.11. Let {e,}h., be a basis ina space V, and let {e!}Piy be the con- 
Jugate basis In L(V). Any skew-symmetric p-form @ € Ap (V) may be represented, 
uniquely, as 


w= >» 
1h <a.  <t psn 


{ “5 
Ons. Ape A eft A. Ae P, (7.55) 


Each term on the right side of (7.55) ts a produet of a constant Os bpadp by a 


skew-symmetric p-form tf eft A.--A et, 
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Proof. By virtue of the results of Sec. 78.1.4 we may write 


n 
Ne 2 : 4 
¥ iris Sate ipe te? ooo © Re (7.56) 


o= ° 
1 ip=1 


ih 4a 


where the numbers ®irtg.. ip = (eit, e@2, ..., e'P) are determined uniquely. 


Since the form wo (8, 5, ..., §p) is skew-symmetric, for any permutation 
c€ Dp 

© (ota) 10) ee Sotp)) = (sgn c) © (Ey, So, «oes Ep). 
Hence 


i ccavtote)* +stg¢p) = (sgn o) inte. tp? (7.57) 


Group together the terms in (7.56) that differ in permutation of the indices 
ty, ig, « - -) fp and use equation (7.57). We get 


= vi > 4g¢1) ig¢p) 
o= oO e ee = 
a i oad one 
<tec...<ip GF OLN OCP) 
‘ : i i 
= » inte. wish (sgna)e%2) .,, e OCP), (7.58) 
ipin<.. «<ip o 


_ By virtue of the example in Sec. 78.1.6 the sum in square brackets is 
et Aet® A... Alt. Thefproof of the theorem is complete. 

Corollary 1. The elements e!* A e A... A MPUASi<in<... ip <n) 
form a basis in Ap (V). That basis is empty for p > n and consists of one element if 
p=n. 

Corollary 2. The dimensionality of the space Ap (V) is CR. 

. In what follows we shall assume as a rule that the chosen basis e;, ¢2, . - +) en 
is fixed and designate the linear forms e! (&) as ef (&) = &#. Then any form 
© € Ap (V) becomes 


(Err Ser veer SPI ON Oya BA oe ABP (7.59) 
i<...<ip 
Example 1. 


EL A E8= (et A €?) (By, &s)= SY] (sgn.o) o fet (By) e? (Ea) = ; 


6 a 
| el By) 8 Ee) — et &e) o? E,) = BEES, 
where &} is the jth coefficient in the expansion of a vector & with respect to the 
basis {e;}. - 
Example 2. 


ELA EZ A... A Et =det )), 


na, 
where &; = » Ee;. he ae ee ; 


75.2. Differential Forms , 


78.2.1. Definitions. Consider an arbitrary open domain G of an n-dimensional 
Euclidean space £”. The points of G are designated x = (2), z7,..., 2"), y= 
= (y', y*, .. +, y®), and so on. 


14—01684 
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Definition. A differential form of degree p defined in Gisa function @ (x, $y, 
21 sees Sp) which is a skew-symmetric p-form in Ap (%) for each fired x € G. 

The set of all differential p-forms in G is denoted by Q, (G) = 2, (G, FE), 

We shall assume that for fixed €,...,€,) € EF" a p-form @ isa function inf- 
nitely differentiable in G. Using the results of Section 7S.{ we may write every 
p-form w as 


$e 


R of - 
o= Noi bn A... AEP. (7.69) 
hn<.<ip P 


In what follows the vector & will be designated og dr =(dz!, dx*, ..., dz") 
and the vectors &, as d,7 == (d,7!, d),x*, ..., d,27), We chouse as a basis in EP 
the vectors ¢, = {0,0,..., 1,0, ..., 0), where the unity is in the kth place. 
Elements of the conjugate basis are the functions ec! () = e! (dr) defined by 
the equations 


eh (dz) = dzh, 
Then the differential form (7.60) becomes 


@ (x, dyt, ..., dpt)= >} On. tp (x) dzt A... A dx'?, 
iis <ip 


Example 1. A differential 0-form is any function defined in a domain G (ond, 
by virtue of our assumptions, infinitely differentiable in G). 
Example 2. A differentiable 41-form is 


n 
w(z, dz)= “ wp (z) dzk. 
h=1 
Jn particular, when n = 4, © (z, a == { (x) dr. A differentiable form of degree { 
is also called a linear differentiable form. 
Example 3. A differentiable 2-form is 
(2, dy2, dyz)= S) wy (z) dzt A dzh, 
ich 
By definition 
dzt \ dzkh=(e! A eh) (dx, daz) =e! (dx) ek (dx)! (daz) eh (dyz) = 
d,zt dyzh 


= t dazh—d. { wt 
dyz Anz dz dyz dazt dazh 








In particular, for; n = 2 we get 
dyz) dyx? 


2 (2, dyzy dzz) = 1) doz) daz? 








The determinant is equal to the aren element corresponding to the vectors dyz 
and d,z. 
In the case where n= 3, denoting @, = R, O35 = P, wy, = —Q, we get 


P QO OR 
o=P dz \ dz'—Qdz A d2+-Rdz Adz? = \d,2’ dyx* dyx|. 
daz dz? dx? 
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Example 4. A differential 3-form in three-dimensional space is 
dyz! dz? dyx3 
 (z, d,z, dax, dgx) =f (x) dx! A dx? A dz3=f (r)| dot! doz? dx? |. 
dgz' dx? dyz3 
The determinant is equal to the volume element corresponding to the vectors 
ayz, daz, dgz. 


78.2.2. The exterior differential. 
Definition. The exterior differential of a p-linear differential form @ € Qy (G) 
is a form dw € Qp+1 (G) defined by the relation 


; rf 
do = 3 Oi... ip NGA... Ade P, 
iy<.. -<ip 
where 
n dao 
41 tp 
104... ip DY ae 
h=1 
Thus, if 
; i 
a= my ap Att. Ade? 
u< +<tp 
then 


n 2 

- 9014. ..ip dah d ty A A d ip 

da= >) > ae Adz aia xP, 
k=1 i1<...<ip 


Example 1. The differential of a form of zero degree (i.e. of the function ~ 
f (z)) has the form 
n 





of 
df (z) = Ork dzk, 
k=l 
Example 2. Evaluate the differential of the linear form 
n 
o=o (rz, dz) = By @; (x) det. 
i=1 
We get 
non 
OW 
do=deo(s, dz, dyz)= »y 2 2012) deh / dat. 
Since dzk A dxt = —dzi A dzk and dzk A det = 0, we have 
do; i 00; 
do = Dy Gee FA dat t+ DY Tob ask \ dat = 
h<i ick 
40: P25 dO, 3 
=D) Gen att A de py el | a 


k<t <i 
OM; dOn )a h * 
=); ( Oak dz! z A dxt, 
k<i 


14* 
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In particular. when n = 2 we ect for @ = P dr + @ ds? 
2 


_ (40  aoP . * 
dws (<5 Sy )e A dz*. 


78.2.3. Properties of exterior differential. The following properties follow 
immediately from the definition 

(4) if wy, € On (G), 2 € Op (G) then d (w,; + os) = do, + des, 

(2) if w € @»y (G) and 7. is‘a real number, then @ (2.0) = 2. do, 

(3) if @,€ Op (G), @, € Og (G), then 

d(w, A 62) =do, A @,+(—1)P o, A dag. 

We prove property (3). Let 

w= Noy dtl. Adz? 

tc... <ty, 

We introduce the following notation: 
do 


dw t1...ip i 4 
—= = dz... Adz. 
ork ark A ge 

ince. s<ipn 


Then dw may be written as 


nm 
dw 
= Ref. 
do = ) dzk A re 
h=1 
Remember that 
o=0, A ©,=(—1)Pt0. A oy 


Further 

GLa) _ a0, L OW, = 00, . dW. 

ozrh — ork A Os + Q@; A azh at azk A @, 7 (—1)P9 aan A Gy 
Then 

n nr 
ea deh Ae => ack A 20% . 
da = »} hE th AS A et 
n “ 
Gn 
(= 1pa Dy dz Ast A @,=do, A O2+(—1)Pl dos J oy. 


hel 
Since dw, is a (g+ 1)-ferm, we have 
do. A oO, =(— 1)P(9)) @, A dda. 


Hence dw = da, A @. + (—1)P @, A aay. ; 
The following important property of{the differential is true. 
The baste property of the exterior differential: 


d (dw) = 0. 
Proof. Suppose first that w is a form of degree 0, i.e. © (x) = f (2). Then 


n n n 
Of aie af 
a=d dtm 2 2s ————— dz f, dz! 
=! 





; a ark dx! 
i=! 
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Since dzt A dzt = —dzi A dzk, this equation may be rearranged in the form 


an= > (a) at nat, 


Ozt Ack = Azxh zt 
ick 


hence d (df) = 0. 
Now let 








i 
o= 2%, ip dt A woe Adz? 


iy<...<ip 
Then 


n 
.? 3 3 
do= >} > d0;,,..5, \ det A... Adz. 
h=t 11<...<ip 


Notice that each term of the sum is the external product offthe differentials 
of 0-forms, i.e. of forms 0j,...;, (2), et (dz), ..., e!P (dz), It remains to apply 


roperty (3) and take advantage of the fact that for the form of degree 0 the 
asic property has been proved. 


7S.3. Differentiable Mappings 


78.3.1. Definition of differentiable mappings. Consider an arbitrary m-di- 
mensional domain D of a Euclidean space E™ and an n-dimensional domain 
Gc E”, Points of D are designated ¢ = (#}, ?, ..., 2) and those of G are de- 
signated z = (z!, 23, ..., 2%). 

We shall say that p maps D into G if 


@ = (P,P, +e OMs 
where gk () are defined in D and vectors z with coordinates zh = gk (t) lie 
in G. 

We define a mapping ¢* transforming Q) (G) into Q, (D) for any p,O< p< 
<n. We shall assume that each component q* (¢) of a mapping @ is infinitely 
differentiable. 

Definition. Let @ be a mapping of DC E™ into GC EN, We denote by 9* 
ne mapping which for all0 < p < nacts from Qp (G) into Qy (D) by the following 
rule: if 


i 
o= Mi ip ett Ao A dz e 


i1<...<ip 
then 
PO) = Dy, (PO) O* 2) A. A pt as"), 
dis... <tp 
where 
a t 
ot (dat) =) SE ann. 


Example . Let ® be a form of degree 0, i.e. w = f (x). Then 

9* () =f @ (). 

Example 2. Let p map an n-dimensional domain D c £7 into an n-dimension- 
al domain G c E®, and let w be the following n-form: 

@ = dz A dz® A... A dzr, 


214 Fundamentals of dfethematical Analusis 





Then 
n n 
n Ok 
(o) = ( — at) A. A( Sate) = 
hy=t hysi ob” 
n n a 1 a ‘“ 
= Sy —E.. Sat yj atin 
am atén 
ky=tk,=l 


agt agr 
=diif.... Adin a (sano) = ociy °* za 


=dl A... A dindet {ss a! —}. 


Thus 
_ _Di(pl, G3, 2.) GM) 

* (dz? A dz? A eae A dz") = — Dis A dt? A eee A dt", 

Remark. The nae *p* () is a differential Jorm obtained from a form @ by 
changing variables 

78.3.2. Properties: of mapping ¢p*. The following properties of the mapping 
g* are true: 

(1) If m, € Qp (G), 2 € Qy (G), then 


p* (@, A Os) = g* (4) A P* (@.). 
Proof. Let 


i 
ac ae > Ay. ..4, AIA... Ade? 


ns -<ip 
~) } hk 
wre Stays aag ede Aon Ades 
hissse<ltg q 
Then 
4 
oyAo=- YY 2»: Piya (2) by, eel 


41S dip Mise shy 
hk 
Xdzt A... Ad2'P Adz A... Adz? 
and hence 


#* (1 Ag) = NY NY ay (g(t) bn (F (8) * (dztty A... Age dr") = 
ik 
=Nayqyot(dztty A. A ot (de?) ALY tno" (dz) A... 
i h 
oe AQ? (az) == q* (@,) A F* (@,)- 


(2) If © € Qp (G), then 
q* (dw) = dq" (w). 
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Proof. We first prove this equation for p = 0, i.e, for w = f (z). We get 
n 


do = Lat, gt @m=fow, 


14 ext 
i 
a= 3 Ziomar= > >a of oe dth= 
h=1 h=1 iwi ? 


= ee > 9 (dz!) = 9* (do). 
i=i 

For an arbitrary p, we carry out a proof by induction. Let O=fi...ip (z) dzt \ 
A.-- A az'?, Then do = Of pg. pA drt \... A dziP, By property (1) 
and the just proved relation 

i 

g* (do)=9* (df) A 9* zt) A... A ot dz ?). 
On the other hand, 

dq* (0) =dg* [(fdz!t A... A dz'P-t) \ dz'P]= 

=d [ep (fda! \... A dz'P-) A ot (dz'P)). 

Further, by property (3) of the exterior differential 


ap* (w) =dq* (f dz#t A... Adz'P-2) A gt (dz?) 4 
+L (—1)P-1 @* (f dx¥t A... A dz*Pot) A dg (dz*?), 


Notice that * diye (z'?) by what has just been proved, and then 
by a basic property of the exterior differential dp* (dz*?) = 0. 

Under the induction hypothesis true for p — 1 

dg* (f drt A... A dz*?-t)=@* (df A dz A ... A dz'P-3). 


As a result we get 


dt (o)=9* (@f A datt A... Adz'P-) A gt (de'?) 
and by property (1) 


dp* (o)=@* (af Adz!f A... Adz'?), 


The next important property is Notes te 

(3) Consider open domains U c El, VOE™, Wo E® whose points are 
u=(u,u*,...,u),0= (v,v,..., om), w = (w', w?, ..., w™), respectively. 
Let @ map UV and let y map V— BW. By xp e @ denote a mapping, called 
composition, which acts by the rule 


(poo) &) = ple @)). 


Similarly we introduce the composition p* e%* which for any p transforms 
Qy (WV) into Qy (U), i.e. 


(g* op*) (w) = —* [y* ()]. 


218 Fundamentals of Mathematical Analysis 


The following statement is true: if Cy = Cg, then 


(oxie 


C Co 
Proof. We give a proof for the case where 
@ = f (r) dz! A dz? A... A dz. 

By definition 


. D(gh, By eeey f 
Jo = | ses en ype ye Ao A ae 
Co yp 


‘3 abe stalee there is a mapping x of a cube 7P onto itself satisfying conditions 
and (2). 

We sale in the integral a change of the variable ¢ = 7 (s), s€ JP. We get 
Fo (1) = pelt (S)] = Gy (5), 


= D (hy Coy +01 PE) DCT, 1%) wey TP) gag gen eu 
5) o=J 1{: 9] B Giga, a0) Dish sh vey ay) NAGA + Ads? 
"9 yP 


a D (Phyo 2+) OF) = 
= J f {71 (s)] D (st, ae $P) ds A aoe A ds? = \ @. 
yP Cy 


Similarly we could show that if Cy = —C,, then 


[o=—fo. 
Cy of 
78.4.2. Differentiable chains. We shall need surfaces that split into several 
ieces, each being the image of some m-dimensional cube. The two circles of the 
oundary of a two-dimensional ring may serve as an example of such a surface. 
We shall distinguish between the orientations of these circles. It appears very 
useful in this connection to introduce linear combinations of singular cubes wit 
teal coofficients. 
Definition 1. A p-dimensional chain C is an arbitrary set 
{21, das we eg Ans C1, Cs, oe eg Ch), 
awhere 2, are real numbers and C; are p-dimenstonal singular cubes. We shall use 
the notation 


CCH Cy 


We shall say that C is in G if all C; are in G. 

The set of p-dimensional chains will form a linear space if we introduce in 
a natural way the operations of addition and multiplication by real numbers. 

Definition 2. The integral of a form w over a p-dimenstonal chain C,contatned 
in G ts 


(o=r (ots { Ott | o 
c Cy Cy Cy 


Now we can define the boundary of an arbitrary singular cube. To do this 
we first define the boundary of a unit cube. 
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Definition 3. The boundary of a cube IP is a {p — 1)-dimensional chain 
P 
al? = 3) (—1 URO—P Oh 
ist 


where I® (1) ts the intersection of the cube I? with the hyperplane zi=a,(a=0, 1). 
For this definition to be correct, it is necessary to make clear how we interp- 
reted the statement that J? (1) is a (p — 1)-dimensional singular cube. 
We construct the canonical mapping 9 = 9f'?of a cube J?-! on JE (i). Let 
s = (sl, st, ..., sP-1) € IP“, We set 


sk ifi<k<i, 
mam a if k=i, 


sk ifi<k<p. 

Obviously @ = (@, g, wares @?) maps JP-1 in a one-to-one manner onto 
T? (i). For @ = 0 and i = p in particular the mapping 9 is the restriction to 
IP (p — 41) of the identity mapping of a space EP onto itself. 

Definition 4. The boundary of a p-dimensional singular cube C = g: IP + E® 
is a (p — 4)-dimensional chain 


Pp 
ac= >) (—D (PUP @)—9 CPM). 
i= 
The boundary of the image of JP is thus the image of the boundary of J” 
with natural orientation. : . 
Example 1. Consider in the plane a square J*, Obviously this square may be 
considered as a singular cube if we take as p an identity mapping. Figure 7.14 


x?) 


a! 





Fig. 7.14 Fig. 7.42 


shows the boundary of the square. Here the direction of the arrows coincides 
with the direction of increase in the parameter #, with respect to which the 
integration is performed, if this side of the square appears in the chain 0J* with 
the plus sign, and is opposite if the side of the square is taken with the minus 
sign. We see that our convention about signs leads to the usual counterclockwise 
tracing of the boundary. 

Example 2. Consider the singular cube C = pp: J2-—> R?, where @ has the 
orm 

gt = (a+ Rt) cos 2nt?, 

g = (a+ Re) sin 2az*. 
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It is easy to see that @ (/*) is a ring whose boundary is formed by circles cf 
radii a and a + R. We shall show what the boundary of a singular cube C is. 
Obviously @ (/2 (1)) is the circle 


q? = acos 2x7, 
q? = asin 2at?, 


Further, q (7? ({)) is a circle of radius a ++ A. Finally, p (7§ (2)) and g (Jj (2)) 
isa segment 22? =0,acg2i'<at+R. 

In Fig. 7.42 the arrows indicate the direction of circulation about the bound- 
ary dC if the boundary @/? is traced counterclockwise. 

Since @ (/§ (2)) — gp (72 (2)) = 0, we may assume that 


aC = 9 FF (N)—¢ (75 (1), 


which coincides with the usual interpretation of the boundary of a ring. 
We shall sce in what way the integral of a form w along the boundary of a 
cube C and that of a form x (o) along the boundary of J? are related. 
Statement. Let C = q: 1? + E® bean arbitrary singular cube contained in G 
and let mw € Qp., (G). We have 


\ O= ( (p* (w). 

éc ayP 

Proof. Obviously, by the definition of the integral over a chain it suffices to 
prove the equation 


j o= [ p* (@). 
o ED) Bay 
Consider the canonical mapping 9 = qe? : Ip-) - 72 (i). By definition 
{ = | aie or. 
IP (4) yp>) 
By property (3) of differentiable mappings (see Section 7S.3.2) 
pt opt =(p 0G)". 


Thus 
f a@=f@a@= | o= [ o 
IP) ppt (gop IP“) eR) 


since (po @) (7?) = @ (IP (i). 

7.8.4.3, The Stokes formula. 

Sain theorem, Let C = q: [P — E* be an arbitrary singular cube contatned 
in G and let w € Qpy (G). We have the Stokes formula 


[ do = { ©. 

¢ éc 

We prove the Stokes formula first for the following special case. 

Let w be a differential form of degree p ~ 1 defined in J?. Then 


{ do = ( @. (7.61) 
IP orP 
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Proof, Let w = f(t) dA... A dt?. By definition! 


fo-Bem( fo fs). 


aiP i=1 IP(i) IP(i) 
Evaluate the following integral: 
@, where i=4, 2, ..., p, @=0, 4. 
1a) 


Consider the canonical mapping g: J?-! + I? (i). By virtue of the results 
of Section 78.4.4 


~ (p23 o 
fo= Free fees no. nase, 


PQ) p-} 
By the definition of the canonical mapping @f*? the Jacobian has the form 


_ D(s?, ..., sft, a, sty ..., sP7l) 


; D(s', s?, ..., sP7}) =0, fish 
and 
1 4 
J= D(st, s?, ..., sP74) re ee 


Ds, 82, 20, SP71) . 
Thus only the integrals over J? (1) may be nonzero and we get 
J o=(—1)( ( o— j o)= 
orP TP(A) IP(1) 
= j F(A, st, s2, ..., sP) dst A... A dsPa— 
ye} 
_ j 710, st, ..., sP-) dst A... A dsPa}. 
ypn1 
By the definition of the integral over the cube /P-1 
4 4 
j aus [ as { [fy 2, 005 8P2)—F (0, st, 0.4 SP] dst ds? .., depts 
orP 6 6 = 


i 1 
=| | - | gy avast. dsr— [SE ase, ... A aor. 
00 0 Pp . 


On the other hand, 


dow St an A dt? A... A dtp. 
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Therefore 
\ do = \ rae A... A dt?. 
i? rP 


Thus equation (7.61) is proved. 
Proof of the Stokes theorem. By the definition of the integral over the sin- 
gular cube 


{do = ( g* (do). 


e 


c iP 
By property (2) of differentiable mappings (sce Section 78.3.2) 
( * (do) = fae" (o). 
iP iP 
Next we use the already proved Stokes formula for the cube JP 
Jag (o)= J oto). 
1P arP 


It remains to notice that by the property of the integrals along the boundary 
of a singular cube (see this at the end of Section 78.4.2) 


\ ¢* (wo) = jo. 
oP ac 


This completes the proof of the theorem. 

78.4.4, Examples. (1) Consider the case p = 14. A one-dimensional singular 
cube C in E® is some curve whose end points are denoted by a and b, The Stokes 
formula takes the form 


fat = |f=10-1(@). 
Cc oe 


In particular, when n = 1 we obtain the Newton-Leibniz formula 


b 
[f (@)az=f)—f (a). 


(2) Now let p = 2. A two-dimensional singular cube C is a two-dimensional 
surface, and a form w € Q, is 


n 
o= >) o, dz". 
k 


=i 


Using Example 2 of Section 78.2.2 we get 


(S (Se— Ser) eo" A at'= f 3 o, dz", 


C ret OC hel 
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If n = 2, then, denoting w = P dz! + Q dz*, we obtain the Green formula 


\(3$-4 — ) az A det= [Pde + Oda. 
Cc 


xe 


If n = 3, we obtain the ordinary Stokes formula. 
(3) Let p = n. Then @ € Q,., has the form 


n 
o= 2D wo, dz! A... A dri! A dx! A... A da 
ji 
Further 


n 
do=> 3208 dat \ dat \...\ d= 


k={ie1 


n 
i 
=> (1h Saat A dat A... Ada". 
hem 
In particular, for n = 3 
=P dz pe ee ee dit+Rdz' A dz, 


oP 
tos: (ser oz} oa +t ax ==) dz A dz® ( dz, 


and we obtain the Ostrogradsky formula. 


‘CHAPTER 8 


THE LEBESGUE INTEGRAL AND MEASURE 


In Chapter 10 of Volume 4 and in Chapter 2 of this volume we 
studied the Riemann integral of a function of ono and n variables 
respectively. The concept of Riemann integral covered a class 
of functions that aro either strictly continuous in a domain under 
consideration or close to continuous functions (the sot of whose 
points of discontinuity has an n-dimensional volume equal to zero). 
This notion turns out to be insufficient in a number of fundamental 
branches of modern mathematics (in the theory of generalized func- 
tions, in the modern theory of partial differential equations and 
sO on). 

In this chapter we present a theory of a moro: general intogral, 
the so-called Lebesgue integral*, for which purpose we develop as 
a preliminary a theory of measure and the so-called measurable 
functions (which are a broad generalization of continuous functions). 

The basic idea of the Lebesgue integral distinguishing it from 
the Riemann integral is that in composing a Lebesguo integral 
sum the points are combined into individual terms not by the prin- 
ciple of their closeness in the domain of integration (as was in the 
Riemann integral sum) but by the principle of the closeness of the 
values of the integrable function at those points. It is this idea 
that allows the notion of integral to be extended to include a very 
wide class of functions. 

It is to be noted that many mathematical theories allowing inter- 
pretation of the integral in the Riemann sense assume a more com- 
plete character when the Lebesgue integral is used. An oxainple 
of such a theory is the Fourier series theory presented using the 
integral in the Riemann sonse in Chapter 10 and tho Lebesgue integral 
in Chapter 14. 

Throughout this chapter the presentation is made for the case 
of a single variable but can be extended without difficulty to any 
number n of variables (an appropriate romark is made at the end 
of the chapter). 





* Henri Lebesgue (4875-1941), a Trench mathematician. 
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8.1. ON THE STRUCTURE OF OPEN AND CLOSED SETS 


We shall consider an arbitrary set £ of points of an infinite straight 
line (—oo, 0). 

The complement of E is the set designated C2 and equal to the 
collection of those points of the infinite straight line (—oo, oo) 
which are not in £. 

If we regard as the difference of sets A and B the collection of 
those points of A which are not in B and denote the difference of 
A and B by A \ B, then the complement CL of £ may he repres- 
ented as 


CE = (—o, o)\ E. 


We recall some definitions introduced in Volume 1. 

4°. A point x is said to be an interior point of a set E£ if there is 
some neighbourhood of z (i.e. an interval containing that point) 
lying entirely in £. 

In what follows an arbitrary neighbourhood of zx will be designated 
v (2). 

2°. A point z is said to be a limit point of £ if in any neighbourhood 
v (x) of x there is at least one point x! of E distinct from zx. 

3°. A set G is said to be open if all the points of that set are interior. 

4°. Aset F is said to be closed if it contains all of its limit points*. 

Let us agree to denote the collection of al] limit points of an arbi- 
trary set £ by E’ and the sum or union of two sets A and Bhy A+B 
or A {J B**, Let us also agree to give the name of closure of an 


arbitrary set Z to a set designated E and equal to the sum E + E’. 

It is obvious that for any closed set / we have Ff’ = F. 

The collection of all interior points of an arbitrary set £ will 
be designated int Z***, 

It is obvious that for any open set G we have intG = G. 

For an entirely arbitrary set Z the set int Z is open and E is 
closed. 

Remark. One can show that int £ is the sum of all open sets 
contained in E and that Z is the intersection**** of al] closed sets 
containing Z. Thus int Z is the largest open set contained in E 


and £ is the smallest closed set containing LZ. 
We shall discuss the simplest properties of open and closed sets. 
1°. If a set F is closed, then its complement CF is open. 


* In particular, a set having no limit points is closed (for an empty set is 
contained in any set). 
** The sum or union of sets A and B is a set C consisting of points lying in 
at least one of the sets A or B. 
*** int are the first three letters of the French word intéricur (interior). 
*e+¢ The intersection of A and B is a sct of points lying both in A and B. 


45—01684 
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Proof. No point z of the set CF is in F, nor is it (by the closure 
of /) in the set F’ of the limit points of /. But this means that some 
neighbourhood v (z) of z is not in F and is therefore in CF. 

2°, If a set G is open, then its complement CG is closed. 

Proof. Any limit point z of the set CG is a fortiori in that set, 
for otherwise z would be in G and since G is an open set some neigh- 
bourhood v (z) of z would also be in G and would not in CG, i.e. z 
would not be a limit point of CG. 

3°. The sum of any number of open sets is an open sel. 

Proof. Let a set E be the sum of any number of open sets G, 
(the subscript a is not an integer in general) and let z be an arbitrary 
point of &. Then (by the definition of a sum of sets) z is in at least 
one of the sets G, and since every set G, is open, there is some neigh- 
bourhood v (z) of z also lying in the set G, and hence in the set E. 

4°, The intersection of any finite number of open sets is an open set. 

Proof. Let a set E be the intersection of open sets G,. G., ... 
- ++, G, and let x be any point of Z. Then for any & (k = 1, 2, ... 
. «+, 2) the point z is in G,, and therefore there is some neighbourhood 
vy, (zt) = (@ — En, = + €,), En > 0, of x also lying in G,. Hf e = 
= min {e,, &., -.-, en}, then the neighbourhood v (z) = (x —¢, 
zx +e) of z is in all G, and consequently in £. 

3°. The intersection of any number of closed sets is a closed set. 

Proof. Let a set & be the intersection of any number of closed 
sets F, (the subscript @ is not an integer in general). Notice that 
the complement CE is the sum of all complements CF,, each of 
which is, according to 1°, an open set. 

According to 3° the set CE is open and therefore in view of 2° the 
set £ is closed. 

6°. The sum of a finite number of closed sets is a closed set. 

Proof. Let E be the sum of closed sets Fy, Fa, ..., Fn. Then 
CE is the intersection of the sets Cy, CF., ..., CF,, cach of 
which is by 1° an open set. According to 4° the set CE is open and 
therefore in view of 2° the set E is closed. 

7°. If a set F is closed and a set G is open, then the set F \G is 
closed and the set G\ F is open. 

Proof. It suffices to notice that / \ G is the intersection of the 
closed sets F and CG and G \ F is the intersection of the open sets 
G and CF. 

Using the above properties we prove a theorem on the structure 
of an arbitrary open set of points of an infinite straight Jine. 

Let us agree throughout the remainder of this chapter to apply the 
term interval to any connected open set (not necessarily bounded) of 
points of an infinite straight line. In other words, an interval is either 
an open interval a << z < 0 or one of the open half-linesa <x < 0 
or —oo <(z <b or an entire infinite straight line —oo <2 <t os. 
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Theorem 8.1. Any open set of points of an infinite straight line 
is a sum of a finite or countable* number of mutually disjoint intervals. 

Proof. Let G be an open set and let x be an arbitrary fixed point 
of G. Since G is open. there is some neighbourhood v (2) of « con- 
tained in G. The sum of all neighbourhoods v(x) of the given fixed 
point z that are contained in G will be designated J (x). We prove 
that J (x) is an interval. 

Denote by a the infimum of the set of all points of J (x) (in case 
the set of all points of J (x) is not bounded below, we set a= —oo) 
and by b the supremum of the set of all points of J (x) (in case the 
set of all points of J (x) is not bounded above, we set b = oo). It 
is sufficient to prove that an arbitrary point y of the interval (a, b) 
is in J (x). Let y be an arbitrary point of (a, b). To be specific assume 
that a < y <2) (the case x <_ y < b is considered quite similarly). 
By the definition of infimum there is a point y’ in J (z) such 
that a< y’ < y. But this means that there is some neighbourhood 
v (x) of the point z we have fixed containing the point y’. By virtue 
of the inequality y’ < y <x that same neighbourhood v (x) con- 
tains the point y. It follows that J (x) too contains y and that the 
proof that J (x) is an interval is complete. One may say that J (z) 
is the largest interval containing the point z and contained in G. 

We now show that if interval J (7,) and J (x2) are constructed 
for two distinct fixed points 2, and z, of G then those intervals 
either have no points in common or coincide. Indeed, if J (2) and 
I(x.) contained a common point z, then they would be both con- 
tained in J (z) and would therefore coincide. 

Having constructed for each of the points x an interval J (z) 
we now select the intervals containing no points in common (i.e. the 
ones that are mutually disjoint). Such intervals each contained at 
least one rational point (we know this from Chapter 2 of {1]). Since 
the set of all rational points is countable (see Section 3.4.6 of [1]), 
the number of all mutually disjoint intervals J (z) is at most count- 
able. Since the sum of all such intervals is a set G, the theorem is 
proved. 

Corollary. Any closed set of points of an infinite straight line is : 
obtained by removing from the line a finite or countable number of mu- 
tually disjoint intervals. 


8.2. MEASURABLE SETS 


8.2.1. The outer measure of a set and its properties. The entire 
theory presented in this section is due to H. Lebesgue. Its starting 
point is using as a primary (original) set the interval A = (a, b) 

* Recall that a countable set is an infinite set whose elements can be enumer- 


ated, i.e. brought to correspond in a one-to-one manner to the natural number 
series 1, 2, 3, ... (see Section 3.4.6 in {1]). 


15* 
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whose length or measure is assumed to he known and equal to 
anumber |A{=b—a>0. 

Let £ be an arbitrary set on the number Jine. A corering S = 
= § (£) of FE is any finite or countable system of intervals {A,} 
whose sum contains the set &. The sum of the Jengths of all the inter- 
vals {A,} constituting a covering S = S (£) is designated a (S). 

So 


6(S)= SJAuI<oo. 
n . 


Definition. The outer measure of a set EF is the infimum of a(S) 
on the set of all coverings S = S (EF) of EF. 

The onter measure of a set £ will be designated | £ |*. So by 
definition 


ji \* =inf a(S). 
S(E) 


Obviously the outer measure of any interval coincides with its length. 
We now show the basic properties of the outer measure. 
1°. If a set Ey is contained in Ej, then | E, \* <1 E, |. 
To prove this it suffices to notice thal any covering of E, is at 
the same time a covering of £;. 
2°. If E isthe sum of a finite or countable number of sets {F} (in 
oS 


symbols Ef = J £E,), then 
I= 


2: \Eal*. (8.1) 


« 

Jens & 
k= 

Proof. Fix an arbitrary e¢ > 0. By the definition of the measure 

| E;, |* as the infimum, for every /& there is a covering S; (£),) of 

a set E, by a system of intervals {A‘} (nm = 1, 2, ...) such that 


SRILA + a. (8.2) 


n=} 


Denote by S the covering of the whole of £ combining all the 
coverings S, (=1, 2, ...) and consisting of all the intervals 
{A1} (ke—-=1. 2, ...3 m=1.2....). Since S is a covering of F, 


we have {Z|*<o(S), but a(S)=™ = JA‘. 





* In symbols the fact that a set Ly is contained in Ey is designated as fol- 
Inws: Fy OC Fs. 
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From the last two relations and from (8.2) we get 
IEI"< > (1Eal* +3) => Esl +e. 
k=1 k=1 


Thus inequality (8.1) is proved. 

Let us agree to regard as the distance between sets £, and E, 
the infimum of the distances between two points of Z, and £, re- 
spectively. 

We shall denote the distance between £, and E, by p (Ey, £,)- 

3°. If p (Ey, E,)>0, then | E,U Ey * = | £, (* + 1 Ey I. 

Proof. Set 6 = (4/2) p(£,, E.). For an arbitrary e > 0 and a chosen 
5 > 0 there is a covering S (Z) of E = E,U E, such that o (S) < 
< |Z |* +e and the length of each interval of the covering | A, | 
is less than 6*. It is obvious that the intervals A, covering the points 
of E, contain no points of E, and conversely the intervals covering 
the points of Z, contain no points of £;. In other words, the cover- 
ing S (EZ) falls into the sum of two coverings S (Z) = S, (E;) + 
+ S,(E,), the first, S,, covering £, and the second, S,, cover- 
ing Z,. So we get : 

S, (By) +82 (Ep) S[E|* +e. 

It follows that | Z, |* + | 2, |* <J£ |* + € and therefore (by 
the arbitrariness of c) | Z, |* + | B, |* < | £ |*. Since on the basis 
of property 2° the opposite inequality |Z |*< |Z, |* + |£, |* 
is also true, we have | Z |* = | BE, |* + |Z, |*. Thus property 
3° is proved. 

In particular property 3° is true if Z, and £, are hounded, closed 
and contain no points in common. 

4°. For an arbitrary set E and an arbitrary number ¢ > 0 there 
is an open set G containing E such that |G |* < |£ |* + €. 

Proof. It suffices to take as G the sum of all the intervals consti- 
tuting a covering S (£) of E for which o (S) << |E |* +e. 

8.2.2. Measurable sets and their properties. 

Definition 1. A set E is said to be measurable if for any positive 
number « there is an open set G containing E and such that the outer 
measure of the difference G\ E is less than e. 

The outer measure of a measurable set E will be called the measure 
of that set and designated | E |. 

It follows from this definition that the measure of a set E is zero 
if and only if the outer measure of that set is also zero. 


* This follows from the fact that given arbitrary ¢ > Oland 5 > 0 there is 
a covering S (£) of E such that o (S) << | EJ* + € and | A, | <6 (for each 
Sy of S). To sec this it suffices to take a covering S’ for which o (S') < | E {* +- 
-++ 2/2, divide each interval of S’ into intervals of length smaller than 6 and 
cover the ends of these last intervals with intervals the total sum of whose 
lengths is less than ¢/2. : 
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We prove a number of statements revealing the basic properties 
of measurable sets. 

Theorem §.2. Any open set is measurable, its measure equalling 
the sum of the lengths of the mutually disjoint constituent intervals. 

The proof is trivial (it.suffices to take G = E in the definition 
and notice that the infimum of o (S$) is attained on the covering § 
coinciding with the subdivision of Z ante the sum of mutually dis- 
joint intervals). 

Theorem §.3. A sum of a finite or countable number of measur- 
able sets is a measurable set. 


co 
Proof. Let E = UY £, such that every £, being measurable. 
n=l 
Fix an arbitrary « > 0. For every set £, there is an open set G, 
containing it such that 


IGnaNEq]* <e-2. (8.3) 
On setting G = U Gu we notice that the set £ is contained in 


Gand that the difference G \. E is contained in the sum U (Gn \ Ey). 


=1 
But then from Property 2° of the outer measure (see Section 8.2.1) 
and from inequality (8.3) we get 


IGNE< IGaNEnl" <e © ome, 


n= n={ 


Thus the ine is proved. 

Theorem 8.4. Any closed set F is measurable. 

Proof. We prove the theorem in two steps. 

1°. First suppose that the set / is bounded. Fix an arbitrary e > 0. 
According to Property 4° of the outer measure (see Section 8.2.1) 
there is an open set G containing F and such that 


|G F<] F J® +e. (8.4) 
By Property 7° of Section 8.1 the sot G \ F is open. By Theorem 8.1 
therefore G \. F can be represented as the sum G\ F= Y A, 

Tiere 
of ‘mutually disjoint intervals A,. The theorem will be proved if 
we establish that 
Ney 

IGNFI* = \ [Ani<e. (8.5) 

n=! 


For every interval A=(a, 6) and for every number @ in the 
interval p< a<(b—apl2, let us agree to denote by A* the 
interval A®=-(a t+ 4, b—a) and by A A® the closed interval A* == 
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=[a+a, b—a]. If, however, «>(b—a)/2, then A® will denote 
an empty set for which |A%|=0. For every n set En= 
n 


n aos 

=U Ay. It is obvious that |E% |*=\’ JA%}. According to Prop- 
=f k=1 

erty 6° of Section 8.1 a set Hy is closed. Since it has no points 


in common with the closed set F, we have (by Property 3° of 
the outer measure) 


[En-+ F|* = |Enl*-+ [FI (8.6) 
On the other hand, since the set Et + F (for any a@ > 0 and for 


every 7) is contained in G, we have (by Property 1° of the outer 
measure) 


[En+F\*< GI". (8.7) 
From (8.4), (8.6), and (8.7) we get 
[Enl*+|FP<IF|* +e (8.8) 


(for all @ > 0 and all n). Since F is bounded .and its ouler measure 
| F |* < 00, from (8.8) we get 


\Enl*<e (8.9) 


(for all w@ > 0 and all n). Proceeding in (8.9) to the limit, first for 
a +0 +0 and then for rn — oo, we obtain inequality (8.5). This 
proves the theorem for the case of the bounded set F. 

2°. If the set F is not bounded in general, then we represent F 


oo 
as thesum / = UJ F,, where F,, is the intersection of closed sets F 


t=! 

and [—n, mn}. According to what has been proved in the first step 
every F,, is measurable (for it is closed and bounded) and therefore 
by Theorem 8.3 so is the set /. The proof of the theorem is complete. 

Theorem 8.5. If a set E is measurable, then so is its complement CE. 

Proof. By the definition of the measurability of #, for any n 
there is an open set G, containing & for which 

IG,\ER <4, (8.10) 
Let. F, = CG,. Since CL, \ CE, = E,\ FE, for any sets] £, 
and E, (check this yourself), CE \ CG, = G, \ E and therefore 
CEN Fx, =G,z \ E. Vt follows from the last equation that for 
any 7 


CEN J. Fy, GyNE. (8.14) 


(Recall that the notation Z, c #, means that #, is in £,.) 
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From (8.11) and from Property 1° of the outer measure we have 
for any n 


ICEN A PyVS |G,NE\* 
and from the last inequality and from (8.10) we have 
ICEN Uo FI" <4 
k=l : 


(for any 7). But this means that the outer measure and therefore 


the measure of the set Ey = CEN UF; equals zero, i.e. the set 
k=l 


mu 
CE equals the sum of the measurable sets Zy and U Ff, (the last 


k=! 
set is measurable by virtue of Theorems 8.4 and 8.3). Thus the 
theorem is proved. 

Corollary. For a set E to be measurable, it is necessary and sufficient 
that given any positive number ¢ we should be able to find a closed set F 
contained in EF such that the outer measure of the difference EF \ F is 
less than e. 

Proof. The measurability of the set / is equivalent to the measur- 
ability of CE (Theorem 8.5), i.e. equivalent to the requirement that 
for any « > 0 there should be an open set G containing CE and such 
that |G\ CE |* <e. But that requirement (by virtue of the 
identity CE, \ CE, = FE, ~\ £,) is equivalent to the requirement 
that for any « > 0 there should be a closed set F = CG contained 
in & such that |E\ F |* = (CF NCE |? = |@N CE <e. 
Thus the corollary is proved. 

Remark 4. The measurability condition contained in the corollary 
just proved may be accepted as another definition of measurability 
equivalent to the definition formulated at the beginning of this 
subsection. 

Theorem 8.6. The intersection of a finite or countable number of 
measurable sets is a measurable set. 

Proof. We shall denote the intersection of sets Ey Lay. 344 


by A E,. By virtue of the identity n EE, =Cl U, CE,)} (check 


n==1 

this’ aonlity yourself) the theorem being proved (Silene immediately 
from Theorem 8.3 and 8.5. 

Theorem 8.7. The difference of two measurable sets is a measurable 
sel. 

A proof follows from the identity A \ Bs= 4 f} (CB) and from 
Theorems 8.5 and 8.6. 

We now proceed to prove the main theorem of measure theory. 
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Theorem 8.8. The measure of a sum of a finite or countable number 
of mutually disjoint measurable sets equals a sum oj the measures of 
those sets. 


Proof. Let E = U E,, such that the sets F, being measurable and. 
1 


mutually disjoint. We consider separately two cases. 

(1) First suppose that all E,, are bounded. Notice that for the case 
where all £, are closed and there are a finite number of them the 
theorem being proved follows immediately from Property 3° of the- 
outer measure (see Section 8.2.1). 

Now let £, be arbitrary bounded mutually disjoint sets. 

By the corollary of Theorem 8.5, for any ¢ >> 0 and for every n 
there is a closed set F,, contained in Z, such that* |Z, \ F, {| €/2™. 
Since all the sets /, are bounded, closed and mutually disjoint, for 
any finite m, by virtue of the remark above 


IU, F, |= =F |. (8.12). 


On the other hand, from the equation £, = (FE, \ F,) U Fr it 
follows (by virtue of Property 2° of the outer measure) that | E, |< 
<IELN Fal + 1 Fa | <lFal + €/2%, so that 


m m™m 
S [Enl< S Fal+e (8.13): 
n=1 n=1 


(for any finite m). From (8.12) and (8.13) we conclude that for any 
finite m 


m m 
SEnl<] U Fale. (8.14) 
n=! n=1 

Now we take into account the fact that the sum of all] the sets F, 
is contained in £. It follows that for any m 


m 
|} U FalS JE], 
n=1 


so that (by virtue of (8.14)) for any m 


m 


> Enl<lEl+e. (8.15). 
n= 
Proceeding in (8.15) to the limit as m — oo, we get 

SJEnI<IE| +e 

n=1 


* Since the measurability of all the sets occurring in the proof has already 
been established we may write everywhere simply measure instead of upper- 
measure. 
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and therefore, in view of the arbitrariness of ¢ > 0, 
= Enl SIE. (8.16) 
ns 


oe 

Now notice that from the equality of the sum U £, to the set E 
nai 

:and from Property 2° of the outer measure we obtain the inequality 


foe] 


(el (2,1 (8.17) 
n={ 


that has an opposite sense. From inequalities (8.16) and (8.47) 
we obtain the statement of the theorem being proved (for the case 
-of bounded sets £,). 

(2) Now let the sets Z, be not in general bounded. Then we denote 
by £% a bounded set Zt = £,  (k& —1< [x2 [< hk) (recall that 9 
Stands for “intersection”). 


co oO 
From the equation Z = U UU £* and from the case considered 


-above it follows that 


| oc oo oc 

[E[= NS (Eal= X |£al. 
=1 k= n=1 

‘This completes the proof of the theorem. 

Remark 2. The fundamental property of measure established by 
‘Theorem 8.8 is called the o-additivity of measure. 

We introduce a new concept to state yet another property of 
measure. 

Definition 2. A set E willbesaidto beaset of the type Gg, if F can 
be represented as an intersection of a countable number of open sets Gn; 
cand a set of the type F,, if E can be represented as a sum of a count- 
cable number of closed sets F,,. 

Theorem 8.9. If a set E is measurable, then there are a set E, of 
the type F, contained in E anda set E, of the type Gg containing E 
for which |E, |= |E |= J], 4, 

Proof. By the measurability of £ and the corollary of Theorem 8.5, 
for any n there are an open set G, containing Z and a closed set F, 
contained in E such that 


|E— Fala IGnNEIS. (8.18) 
Set Ly = U Fy, Ey = f\ Gy. Since for any n 
nest nhesf 


ENE,CENF, B,NECGANE, 
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by (8.18) and Property 4° of the outer measure 
JENE<+, jB\zI<4+. 


By virtue of the arbitrariness of nm it follows that | \ £, | =0 
and |Z, \ £ |=0. Thus the theorem is proved. 

Remark 3. Note that there are nonmeasurable sets. To construct 
them it suffices to take into consideration that on a unit circle there 
are a countable number of mutually disjoint and congruent* sets 
whose union is equal to the set of all the points of that circle. Such 
are the set E of all the points of a circle any two of which cannot be 
made to coincide by rotation through an angle of n-a, where n is 
any integer and «@ is a fixed irrational number, and all the sets E, 
obtained from FE, by rotation through an angle of n-a. Were Ep 
measurable, then so would be all the sets Z,, | £, | = | #q | for 
all integers n. But then by virtue of Theorem 8.8 we would get 21 = 


= >) |&, |, which is impossible for any value of | £, |. 


n=-—0o 
8.3, MEASURABLE FUNCTIONS 


8.3.1. The measurable function. Let us agree to mean by an ezten- 
ded number line the ordinary number line —co < x < oo comple- 
mented with two new elements, —oo and -+oo. To extend the arithme- 
tic operations to include the extended number line, let us agree to 


assume that a -+ (+00) = -oo, a + (—oo) = —oo (for any fini- 
te a); (+00) + (+00) = +00, —oo + (—00) = —o0; (+00) — a= 
= ae (00) —a = —oo (for any finite a), (+00) -—- (—o) = 
= +00, —oo — (+00) = —o; a-(-L00 oo) = +00 for a>O0, 
0- «(-+00) = 0, a-(+00) = —oo for a<0; (+00) (-+00) = +00, 
{+-00)-(—c0) = —oo, (—00)-(—00) = +00, 0+(—00) = 0, a-(—o0)= 


=—oo for a>0, a-(—o) = +00 for a < 0; +-00/a = (--00)-1/a 
for any finite as£0, a/too = 0 for any finite a. 

Only the following operations remain undefined: 

(+00) ++ (00), (+00) — (+00), (—c0) — (00), to0/-b oo. 

Throughout the remainder of this chapter we shall discuss func- 
tions defined on measurable sets of the ordinary number line and tak- 
ing values on the extended number line. 


—oo when r<—1, 
f(z)= 0 when —1<r<c1, 
+oo when r>1 
may serve as an example of such a function. 
~~ * In this case the term “congruent” must be taken to apply to two sets one of 


which may be made to coincide with the other by rotation through some angle 
in the plane of a circle. 
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Let us agree to denote henceforth by £ {f satisfies condition 1} 
a set of all values of 7 in Z for which f (xz) satisfies condition 4. 

For example, £ [f > a] is a set of those values of z in £ for which 
f(z) >a. 

Definition. A function f (x) defined on a measurable set E is said ty 
be measurable on that set if for any real number a the set FE |f >a} 
is measurable. 

Theorem 8.10. For the function f (x) to be measurable on a set E 
it is necessary and sufficient that one of the following three sets: 


Elf>al, Elf<al, Elf<al (8.19) 


should be measurable for any real a. 
Proof. ({) From the definition of measurability of the function 
f(z). from the elementary relations 


E\f>al= U E[f>a+ +}, 
n=1 home 


EijSa= El {> a—-;| 


and from Theorems 8.3 and 8.6 it follows that the measurability 
(for any real a) of the set E [f >a] is a necessary and sufficient 
condition for the function f (x) to be measurable on the set £. 

(2) From the relation Elf<a)= EN EljSa) and from 
Theorems 8.3 and 8.7 it follows that the measurahility (for any real a) 
of the set F [f <a} is a necessary and sufficient condition for f (x) 
to be measurable on E£, 

(8) Finally. from the relation E(f<aJ)= EN Elf>al, from 
Theorems 8.3 and 8.7, and from what has been proved in (1) it fol- 
lows that the measurability (for any real a) of the set E lf<al 
is a necessary and sufficient condition for f (x) to be measurable 
on £. Thus the theorem is proved. 

Remark. By virtue of Theorem 8.10 the measurability (for any 
real a) of any of the three sets (8.19) may be accepted as another 
definition of the measurability of the function f (z) on a set £ equiva- 
lent to the definition formulated above. 

8.3.2. Properties of measurable functions. 

1°. Tf a function {(7) is measurable on a set E, then it is measurable 
on any measurable part E, of E. 

The proof follows immediately from the identity Z£, [f> a)= 
= E,1) Elfa] and from Theorem 8.6. 

2°. Ifaset FE is a finite or countable sum of measurable sets £,, and 
if { (z) is measurable on every set E,, then it is measurable on the set E. 

The proof follows immediately from the identity FE {fal = 


= U E,, {f >a) and from Theorem 8.3. 
ne=} 
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3°. Any function f(x) is measurable on a set E of measure zero. 

Indeed, any subset of a set of measure zero is measurable and has 
measure zero. 

Definition 1. Two functions f (x) and g (x) defined on a measurable 
set E are said to be equivalent on that set if the set E lf = g} is of 
measure zero. 

The notation f ~ g is often used to denote functions f (z) and 
g (x) that are equivalent (on a set £). 

4°. If f (x) and g(x) are equivalent on a set E and fz) is measurable 
on E, then so is g (x). 

Proof. Put E, = E{f-~ gl, Ey =~ EN Ey. Since on EF, g (z) 
coincides with f (x), g (z) is measurable on E, (by virtue of Proper- 
ty 1°). According to Property 3° g (x) is measurable on Z, as well as, 
therefore, according to Property 2° g (x) is also measurable on E. 

Definition 2. We shall say that some property A is true almost 
everywhere on a set £ if the set of points of & on which that property 
is false is of measure zero. . 

Corollary of Property 4°. If a function f (x) is continuous almost 
everywhere on a measurable set E, then f (x) is measurable on E. 

Proof. First notice that if f (z) is continuous on a closed set F 
then f (x) is measurable on /, for F {f >a) is closed for any real a 
and, therefore, measurable. Suppose that f (z) is continuous almost 
everywhere on an arbitrary measurable set E and denote by R a 
subset of all discontinuity points of f (x) of measure zero. 

By virtue of Properties 2° and 3° it suffices to prove the measur- 
ability of f (z) on the set E, = E\R. By Theorem 8.9 there is a set 
E, of the type Fg (see Section 8.2.2) contained in £, such that 
|£,| = |£, | = |Z |. By virtue of the same Properties 2° and 3° 
-it suffices to prove that f (z) is measurable on /,. But E, (as a set 
of the type F,) can be represented as a countable sum of closed sets I’, 
on each of which f (z) is continuous and therefore (in view of the 
above remark) measurable. But then by Property 2° f (z) is measur- 
able on £,. : 

Remark. We stress that the continuity of a function f (z) almost 
everywhere on a set & should be distinguished from the equivalence 
of f (x) on E to a continuous function. Thus the Dirichlet function 
f(z) = 1, if z is rational; f (z) = 0, if x is irrational and continuous 
at no point of [0, 1] (see Chapter 4 of {4]); but it is equivalent on 
{0, 4] to the continuous function g (z) = 0 since f (zx) + g (x) only 
on the set of all rational points of (0, 1] which is countable and is 
therefore of measure zero*. 

8.3.3. Arithmetic operations on meaSurable functions. We first 
prove the following lemma. 

* The fact that a countable set of points is of measure zero follows from 


Theorem 8.8 and from the fact that the measure of a set consisting of a single 
point is zero. 


238 Fundamentals of Mathematical Analysis 


Lemma 1{. (1) Jf a function f (x) is measurable on a set E, then so 
is the function | f (x) |. (2) Jf f (x) is measurable on E, and C is any 
constant, then either of the functions f (x) + C and C-f (x) is measur- 
able on E. (3) If f (xz) and g (x) are measurable on EF, then the set 
Ef > g) is measurable. 

Proof, (4) It suffices to consider that for any nonnegative a 


Etlfla>a=ElfSalyu Elfj<—al 


and use Theorem 8.3. If, however, a <0, then E Uf | > al coin- 
cides with E and is also measurable. 
(2) It suffices to use for any real a@ the relations 


E[f+Cpa\=L£{fea=C], 


E [14] when C>0, 
E[(C-fpa)= ; : 
ee when C>0. 


If, however, C = 0, then C-f (x) = 0 and is also measurable. 
(3) Let {r,} be all rational points of an infinite straight line 
(—oo, oo). It suffices to consider that 


E> a= U (EU > rl NE le<ral) 


and use Theorems 8.3 and 8.6. Thus the lemma is proved. 

On the basis of Lemma 1 we prove the following theorem. 

Theorem 8.11. If functions f (x) and g (x) take finite values on 
a set FE and are measurable on it, then each of the functions { (zr) — 
— 8 (2), f(z) + g (@), f (@)-g (a), and f (z)/g (x) (for the quotient 
f (x)/g (x) we require in addition that all the values of g (x) should be 
nonzero) is measurable on E. 

Proof. (4) To prove that the difference { (x) — g (x) is measurable 
it suffices to notice that for any real a the set E {f — g >a] coin- 
cides with the measurable (by Lemma 1) set E [f > g + al. 

(2) To prove that the sum f (x) + g (x) is measurable it suffices 
to consider that f + g = f — (—g) and that the function —g (z) 
is measurable by Lemma 1. 

(3) To prove that a product of two measurable functions is mea- 
surable we first show that the squarefof a measurable function is 
a measurable function. Indeed, if a <0, then the set £(f>al 
coincides with # and is therefore measurable. If, however, a> 0, 
then the set Z (f* > a] coincides with the measurable (by Lemma 1) 
set El{f {> Val. From the measurability of the square of a mea- 
surable function and from the measurability of the sum and the dif- 
ference of measurable functions, by virtue of the relation f-g = 
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= 1/4 (f + g)? — 4/4 (f — g)* it follows that the product f (x) g (x) 
is measurable. 

(4) By virtue of the measurability of a product of two measurable 
functions, to prove that the quotient f/g is measurable it suffices 
to establish that 1/g is measurable, but this follows from Theorems. 
8.3 and 8.6 and from the relation 


Elg>one[e<=]| when a>0, 
E[=>a]= E{g>0] when 'a=0, 
Elg>O]UE[g<—] when a<o. 


The proof of the theorem is complete. 

8.3.4. Sequences of measurable functions. We prove several im- 
portant statements relating to sequences of measurable functions. 

Theorem 8.12. If {f, (x)} is a sequence of functions measurable on 
a set FE, then both the lower and upper limits of the sequence* are func- 
tions measurable on E. 

Proof. We first show that if a sequence {g,, (x)} consists of func- 
tions measurable on £, then either of the functions** @ (2) = 
== inf g, (x) and wp (x) = sup g, (z) is measurable on Z£. It suffices 

n 


n 
to take into consideration the relations 


Ele<a]= U Elé<ah 


Elyp>al= U Elen >al 


and use Theorem 8.3. 

Now denote the lower and upper limits of {f, («)} respectively 
by f (x) and f (x). To prove that f (x) and f (x) are measurable on E 
it suffices to notice that i 


i(2)= sup {inf fn (x)}, f(z) = int (sup fa (2)} 


and use the statement proved above. Thus the theorem is proved. 


* In Chapter 3 of [1] we have proved the existence of the lower and upper 
limits in any bounded sequence. Here we agree to assume that if a sequence is 
not bounded below (upper), then its lower (upper) limit is equal to —co (-+00), 

** The notation m (z) = inf g,, (z) means that at every point x the value of 


n 
@ (z) is the infimum of the values g, (x), go (z), .. . at that point. The notation 
sp (z) = sup g, (z) has a similar meaning. 
n 
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Theorem §.13. If a sequence {f, (x)} of functions measurable on 
a set E converges almost everywhere on F toa function f (x), then f (x) 
is measurable on E. 

Proof. In the case where a function {f, («)} converges to f (z) 
everywhere rather than almost everywhere on £ the statement of 
the theorem on the measurability of f (7) follows at once from Theo- 
rem 8.12. If, however, {f, (z)} converges to f (x) everywhere on F, 
except the set /, of measure zero, then f (x) is measurable on F \ Ly 
by virtue of Theorem 8.12 and is measurable on £, as a set of measure 
vero (Property 3° of Section 8.3.2) and hence on the set £ = 
=(E\ E,)U E, (by virtue of Property 2° of Section 8.3.2). Thus 
the theorem is proved. 

Now we introduce an important concept of convergence of a se- 
quence in measure on a given set. 

Definition. Let functions f, (x) (n=1,2,...) and f (x) be mea- 
surable on a set E and take on finite values almost everywhere on E. The 
sequence {f, (x)} is said to converge to f (x) in measure on E if for any 
positive number & 


lim|Z [|f —fnl el] =0, (8.20) 
N--o 


i.e. if for any positive e and § there is NV such that when rn >wW 
we have |Z (| f —f, |e] |<. 

H. Lebesgue proved the following theorem. 

Theorem 8.14. Let E be a measurable set of finite measure and let 
functions f, (z) (n = 1, 2, ...) and f (x) be measurable on E and 
ake on finite values almost everywhere on E. Then the convergence of 
{fn (x)} to f (x) almost everywhere on E implies the convergence of 
{fn (x)} to f (x) also in measure on E. 

Proof. Set A =E[|f|= +o], An = Ellf, | = tol, B= 


=ENEllim f, =f], C=A+B+ QU A,. Then under the 


N00 n= 
condition of the theorem | C | = 0, the sequence {f, (z)} converges 
to f(z) everywhere outside the set C and all the functions f,, (z) 
and f(z) have finite values. 
For an arbitrary ¢ >0, set EF, = El|f—faloel, Ra = 


Loo} 
= |J £,. Then, since £, is contained in R,, we have [/, |< 


heen 
<|[R, |, and to prove (8.20) it suffices to establish that | R, | +0 
as n —> 0. 

Denote by RF the intersection of all sets 2,, Re, ... to show that 
[| R, | >] R las n + oo. By construction 2,41 is contained in I, 
for every » and therefore for every n 


RwaNR ae JY (2; NR) 5) 
Lon 
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with the sets under the summation sign mutually disjoint. But then, 
by Theorem 8.8, for every n 


[RaNRl= > [aN Raat (8.24) 
and, by the convergence of the series 
IRIN] = IRaNRastil, 


the remainder of the series (8.21) converges to zero as n +00. So 
{Rr \ R | —-0 as n + co. But by virtue of the relation { R, | = 
={({R,\R|+|]A| this means that |R, | —>|AR| as noo. 

Now, to prove (8.20) we establish that |. R | = 0. To do this it 
is in turn sufficient to establish that R is contained in C. 

Let xz) be any point outside C. Then for the arbitrary e > 0 we 
have fixed there is N (x, &) such that [f, (to) — f (to) [|< 
when 2 > WN (xp, &). But this means that when n > N (2, €) the 
point z, is not in Z, and, the more so, it is not in R, or in the set 
R which is the intersection of all R,. 

So any point xz) which is outside C is also outside R. But this 
means that R is contained in C. Thus the theorem is proved. 

Remark. We stress that convergence of a sequence {fp (x)} to 
f(z) on E in measure implies neither the convergence of {f, (x)} 
to f (x) almost everywhere on £, nor even the convergence of ye (zx)} 
to f (x) at at least one point of E. It suffices to consider the example 
constructed in Section 1.2.3. The sequence {f, (x)} in that example 
diverges at each point of the closed interval [0, 1], but since every 
function f, (z) is nonzero only on the closed interval J, whose length 
tends to zero aS mn —> oo the sequence {f, (x)} converges to the func- 
tion f (z) = 0 in measure on [0, 4)... 

Nevertheless Frigyes Riesz™ proved the following theorem. 

_ Theorem 8.15. Let E be a measurable set of finite measure and let 
functions f, (x) (wn = 1, 2, ...) and f (x) be measurable on E and 
take on finite values almost everywhere on E. Then if {f, (x)} converges 
to f (x) in measure on E, we can choose a subsequence of {f, (x)} con- 
verging to f (x) almost everywhere on E. 

Proof. We may assume without loss of generality that f,(z) and 
f(z) take on finite values everywhere rather than almost everywhere 
on £ (otherwise the same sets A and A, would be introduced that 
were in proving the previous theorem and all the reasoning would 


be carried out for the set E\A U A,). It follows from the con- 
n=t 

vergence of {f,(z)} to f(z) in measure on Z£ that, given any k, 

we can find m, such that for the measure of the set Z,=£ [|f— 


* Frigyes Riezs (1880-1956), a Hungarian mathematician. 
16-01684 , 
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—fu,l {/k] we have JE, |< 1/2". Set, asin the proof of the previous 


a oc 4 
theorem, #2,= U £,, R= 1 Ry. Then by the property of the 
L=n n={ 
in) 
outer measure (sce Section 8.2.1) |Ral[= S’JE,], so that [Ay] < 
ken 


< Sy 1/2* = 1/2". Thus |R,]—>0 as noo. As in the previous 
h=n 

theorem, we can prove that |@,/—~|R| as n— oo. This yields 

[R| =0. 

It remains to prove that everywhere outside R the sequence 
{7n, (z)} converges to 7 (x). Let x he an arbitrary point of ZX. Then 
zx is not in the set Ry for some N=N(z). But this means that 
z is not in £, when k>N(z). In other words, [f (z)—/fn, (H< 
<i/k when k>N (z). Thus the theorem is proved. 


8.4. THE LEBESGUE INTEGRAL 


8.4.1. The Lebesgue integral of a bounded function. A subdivision 
of a measurable set £ is any family 7 of a finite number of measur- 
able and mutually disjoint sets £,, £,,..., E, of E adding up 
to the set £. 

To denote a subdivision of a set Z we shall use the symbol 7 = 
={E,}Ray or T ={£,} for short. 

Consider on a measurable set FE of finite measure an arbitrary 
bounded function f (x). For an arbitrary subdivision 7 ={E,} of E 
we denote by 1%, and m), respectively the supremum and infimum 
of f (xz) on a subset £; and define the two sums 

n 


n 
Sp= = M),[E),| and tre my\Ex| 


valled respectively the upper and /Jower sums of the subdivision 
LT = {EF}. 

Note at once that for any subdivision 7 = {F,,} 

Sp < Sy. (8.22) 


For any function f (x) bounded on a set of finite measure Z both 
the set of all upper sums {57} and the set of all lower sums {s;} 
(corresponding to all possible subdivisions 7 = {£,} of the set /) 
are bounded. There is therefore an infimum of the set {S;}, which 


we designate J and call the upper Lebesgue integral, and a supremum 
of {s;}, which we designate J and call the lower Lebesgue integral. 


Definition. A function 7 (x) bounded on a set of finite measure E is 
said to be (Lebesgue) integrable on that set if J = J, i.e. if the upper 
and lower Lebesgue integrals of the function coincide. 
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The number I = T is called the Lebesgue integral of f (xz) over E and 
designated 


j f (x) dz. 
E 


We discuss some properties of the upper and lower sums and of the 
upper and lower Lebesgue integrals. 

Let us say that the subdivision T* = {E7}fL, is a refinement of 
the subdivision T = {£,}i-, if for any i (i = 1, 2, ..., m) there 
is v (i) satisfying the inequalities 4< v (i) <n such that Ej is 
contained in Fy,;). 

The integer v (i) may turn out to be the same for different i, the 
sum of the sets Zj over all i for which v (i) equals the same integer k 
is obviously equal to a set £y, i.e. 

U E=E£, (8.23) 
v(=k 

Let us also say that the subdivision 7’ = {£;} is a product of subdi- 
visions 7, ={E}’} and 7, = {£7} if T consists of the sets E; which 
are the intersections of all possible pairs of sets EP and E?, ie. 
if every EZ; is equal to £2’) £7, all possible combinations of p 
and q exhausted. . 

Obviously the product 7 of two subdivisions T, and 7, is a refine- 
ment of either of the subdivisions 7, and 7. (any other subdivision 
of L which is a refinement of both 7, and 7, is itself a refinement 
of 7’). 

the following properties of the upper and lower sums and of the: 
upper and lower integrals are valid. 

4°. If a subdivision T* is a refinement of a@ subdivision T, then. 
Sp < Spx, Ste < Sy. 

Proof. We give a proof for the upper sums (since for the lower 
sums the proof is quite similar). Let 7* = {E;}7L, be a refinement 
T ={E,}r-, and let A/7 be the supremum of f (x) on a set Ef (i = 
...-, m) and M,, the supremum of f (z) on a set E, (k = 


? 7 


= 25 + + ). 
By the definition of refinement for every number i (i = 1, 2,... 
. -, m) there is a corresponding integer v (i) satisfying 1< v (i) < 
< nsuch that E7 is contained in £,;), the sum of the sets Ej over 
all i for which v (i) equals the same & satisfying equation (8.23). 
It should be added that for all i for which v (i) equals the same 
integer k 
Mi<M, (8.24) 
(for the supremum cna subset does not exceed the supremum on the- 
whole of the set). ‘ 
16% 
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From the definition of the upper sum and from relations (8.23) 
and (8.24) we get* 


re Tn 

Spe= SN AEN = VIS ANETN< 
i={ hot vise) 

xX 


oe 1ET]) —— M,\E,|=Sr. 


n 
< = My, { 
het “"( 


2°. For two quite arbitrary subdivisions T, and T., sy, < Sr, 


a 


Proof. Let 7' be the product of subdivisions 7, and 7',. Since T 
is a refinement of cither of the subdivisions 7, and 7., by Property {° 

S7,< Sp, Sp<Sr,. (8.25) 
From inequalities (8.25) and (8.22) it follows that sr, < Sr,. 

3°. The upper and lower Lebesgue integrals are connected by the 
relation T</. 

Proof. Fix an arbitrary subdivision 7,. Since for any subdivision 
T; (by Property 2°) sr, << Syz,, the number Sy, is one of the upper 
bounds of the set {s7,} of all the lower sums, and therefore the 
supremum IJ of that set satisfies the inequality J < S7,. Since the 


last inequality is true for an arbitrary subdivision 7'., the number / 
is one of the lower hounds of the set {Sz,} of all the upper sums, 
and therefore the infimum J of that set satisfies the condition J <J. 

Corollary. Any Riemann integrable function is Lebesgue integrable, 
the Lebesgue and Riemann integrals of such a function coinciding. 

Proof. Let f(z) be Riemann integrable on EZ =[a, bJ (and there- 
fore bounded on that interval). For such a function we denote by J 
and J the lower and upper Lebesgue integrals and hy Jp and Tp 
the Jower and upper Darboux integrals (see Chapter 10 of [1]) 
to obtain the following inequalities** 

IpSI<T<Ty. (8.26) 


If a function is Riemann integrable, then for it 7p = 7p and by 
(8.26) therefore J = 7, i.e. that function is Lebesgue integrable. 
Moreover, when Sp = J, (8.26) implies Ipele= Poly, ic. 
they imply the coincidence of the Riemann and Lebesgue integrals, 


* We take inte account that from (8.23) and from the sets Ef being 
mutually disjoint it follews, by Theorem 8.8, that y PERE VE. I. 


Z viijek 2 
** Because any subdivision E = fa, 4) into subintervals is included in the 
class of subdivisions of the set £ in the sense of Lebeseue. 
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for the former is equal to the number Jz = Ip and the latter to 
r=f, 

In the next subsection we shall show that the class of Lebesgue 
integrable functions is wider than the class of Riemann integrable 
functions. This will clarify the appropriateness of introducing 
measurable functions. 

8.4.2. The class of Lebesgue integrable bounded functions. We 
prove the following main theorem. 

Theorem 8.16. Whatever a measurable set E of finite measure may 
be, any function f (x) bounded and measurable on E is integrable on it. 

Proof. Construct a special subdivision of a set E called Lebesgue 
subdivision. We denote by AZ and m the supremum and infimum of 
f(z) on Z and divide the interval [m, A‘), using the points m = 
= Yo SUS Ya --- < Yn = M, into subintervals [y,_1, yx] 
(k = 1, 2, ..., 2) and denote by 6 the length of the largest of the 
subintervals, i.e. set 


5= max Yam Yas): 


A Lebesgue subdivision of a set E is a subdivision T = {E,}f=1 in 
wach Ei, =Ely<f<yl, Ex = Eluny<f<y,) for k= 
2 ea reer an 

Let S; and sp be the upper and lower sums corresponding to 
a Lebesgue subdivision 7 and called the upper and lower Lebesgue 
sums. Notice that for any & (k = 1, 2, ..., n) 

Yaa Sm, <M, Sp (8.27) 


where AZ; and m, denote the supremum and infimum of f (x) on 
a subset Z,. Multiplying inequalities (8.27) by the measure [Z,] 
of the set Z, and then summing them over all &k = 1, 2, ..., 
we have 


n n 
2 sla <sr<S7 < Si nlEr- 


From these inequalities we conclude that 
n n 
0<Sr—sr <D YalEal— 2 Yr-slEnl = 


n 
gel (Yr— Yn) LE |< SJE}. (8.28) 
Since for any subdivision 7 we have sy <i<i < Sy, from 
(8.28) we get 
O0<I—I<6j£}. (8.29) 


DAG Fundamentals of Mathematical Analusis 


Since 6 > 0 may be fixed as small as we please, it follows from 
(8.29) that / = J. Thus the theorem is proved. 

Remark 1. In Supplement 2 to this chapter we prove that the 
measurability of a function f(z) bounded on a measurable set E 
is not only a sufficient but also necessary condition for that function 
to be Lebesgue integrable on £, 

Remark 2, Let & (& = 1, 2, ..., 2) be an arbitrary clement 
of A subset E;, of a Lebesgue subdivision 7. A sum op (&,, f) = 


-¥ 2 1 (En): | £, | will be called a Lebesgue integral sum of f (x). 


Since under an arbitrary choice of points €, on the sets /), that sum 
is contained between the lower and upper sums of the corresponding 
Lebesgue subdivision 7, it follows from inequality (8.28) that 
or (,, f) baa with Sp and sy) tends, as 6 —0, to the Lebesgue 


integral J = ) /(@) dx. 


8.4.3. Properties the Lebesgue integral of a bounded function. 
. {1dr = E}. 


E 
To prove this it suffices to notice that for the function f (7) = 
both the upper and the Jower sum of any subdivision 7 of a set £ 

is equal to | £ |. 

2°. If a function f (x) is bounded and integrable on a set FE of finite 
measure and a is any real number, then the function la-f (x)] is also 
integrable on FE, with 


fta-ftaaz=a. Vj (z)dz. (8.30) 
E E 


Proof. For an arbitrary subdivision 7 ={E,} of a set /, denote 
the upper and Jower sums of the function f (z) by Sz and sy and the 


upper and Jower sums of the function [a-f(x)] by Sf and sp. Then 
clearly 


as | aS; when a>0, 
my asp When «<0, 


(a) 


&-Sr When a>0. 
sp = 


(8.35) 
“@-Sr when 2<0. 


If we denote by 7 and J the upper and lower integrals of f (z) and 


by F@ and J@ the upper and lower integrals of fa-f(z)], then it 
follows from (8.31) that 


ee when @>0, { a-J when 220, 
T 


[(2) —_ 
when 4<0. 


(8.52) 
a-I whenae<0. - 


J) = 


By virtue of the integrability of f (z) 


I af= j f(x) dx 
E 
and therefore from inequalities (8.32) it follows that for any a 


7) — [M=q. { f(x) dz. 
- E 
This just means that the integral on the left of (8.30) exists and that 
equation (8.30) is true. 
3°. If either of the functions f, (x) and f, (x) is bounded and integra- 


ble on a set of finite measure E, then the sum of the functions 
{f, (c) + fe (x)] is integrable on E, with 


Vth) +f @dz= Jf @ax+ Vyo(2) de. (8.33) 
E E E 


Proof. Set f (z) = f, (z) + fs (x) and let T = {E,) be an arbitrary 
subdivision of Z. For the function f (x) denote the supremum and 
infimum on a subset £, by Af, and m,, the upper and lower sums of 


T by Sz and sz, and the upper and lower Lebesgue integrals by I 
and J. Similar quantities for the functions 7, (r) and f, (x) we denote 


by the same symbols as for f (x) but with the superscripts (4) and 
{2) respectively. 

Notice that the supremum (infimum) of a sum is not greater (not 
less) than the sum of the suprema (infima) of the summands. It follows 
that for any & 


me + m2 <m,<M,< MY + MM? 
and therefore for any subdivision 7 

SP + 9 Sop S57 <SP + SP. 

From these last inequalities it follows then that 

IM 4JO<T< <I) 4 Je, (8.34) 
Since (due to the integrability of f, (x) and f, (z)) 
IH = TW = \f,(2) de, 1=Fe = | fp (2) de, 

E E 

from (8.34) we get 


t=T= \fA(jazt § fa(a)az. 
E E 
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But this just means that the integral on the left of (8.33) exists and 
that equation (8.33) is true. 

Corollary. Properties 2° and 3° lead directly to the linear property 
of the integral: if either of the functions f, (rz) and f. (z) is bounded and 
integrable on a set of finite measure £ and if a and B are arbitrary 
real numbers, then the function la-f, (z) + B-fo (z)] is integrable on E, 
with 


Jie @)+Bfe(zaz=a- VA (zydz+Bp [fe(2) az. 
E EB 


by 


4°. If a function f (x) is bounded and integrable on either of the dis- 
joint sets of finite measure E, and E., then f (x) is integrable on the 
sum E of the sets E, and E. as well, with 


j f(a)dz= | f(2)de+ (f(z) az. (8.35) 

E Ey E, 
This property is usually called the additivity cithe integral. 

Proof. Notice that the union of an arbitrary subdivision 7, of 
the set £, and an arbitrary subdivision 7, of E, forms a subdivision 
T of the set E = £, J E.. Denote the upper sums of f (x) corres- 
ponding to 7,, T, and T by Sy,, Sr, and Sy respectively, and the 
lower sums of f (z) corresponding to 7), TJ, and 7 by srz,, sy, and 
Sp respectively. Then clearly 

Sy = Sr, + Sty Sy; = S7, +S$1,- (8.36) 
Denote the upper and lower integrals of f (x) over E, by J® and I, 


those over E, by 7@) and J@ and those over E by J and /. 


From equations (8.36) and from the fact that the supremum 
(infimum) of a sum is not greater (not less) than the sum of the supre- 
ma (infima) of its terms we conclude that 


IME IOC <I <iM+ Te, (8.37) 


Since (due to the integrability of f (z) on E, and on £,) J = J@) = 


={ f@d, 10=7o = j f(x) dz, from (8.37) we get 
PI 


T=T= | f(xy det (f(2)dz. 
zB g, 


But this proves that the integral on the Jeft of (8.35) exists and that 
equation (8.35) is true. 

5°. Jf either of the functions f, (xz) and f, (x) is bounded and integra- 
ble on a set of finite measure E and if everywhere on that set f, (x) > 
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> fe (x), then 
(f(x) dx | f.(@) de. (8.38) 
E E 


E 
Proof. Since all the lower sums of the function F (x) = f, (v) — 


— f(x) are nonnegative, J >0. It follows that ( F (x) du = 
E 
= | fy (x) dz — ( fo (z) dx >0 (the existence of the integral 
2 A 


E 
and the above equality follow from the linear property already 
proved). This proves (8.38). 

8.4.4. The Lebesgue integral of a nonnegative unbounded functiom 
and its properties. We now proceed to define the Lebesgue integral 
for the case where the measurable function f (z) is not bounded. We 
first assume f (x) = 0 everywhere on a set of finite measure E. 

For any V>0, we set 


(f)x (2) = min {N, f (z)}, (8.39). 
Ty (f)= J (fw (2) dz. (8.40) 
E 


Notice that for any function f (z) measurable on EF the function 
(8.39) is also measurable* and therefore the integral (8.40) exists. 
Note also that from (8.39) and (8.40) it follows that J y (f) increases 
as NV increases. 

Definition. If there is a finite limit I y (f) as N -> 00, then f,(x) 
is said to be (Lebesgue) summable on a set E and the limit is said 


to be the integral of f (x) over E and designated { f (x) dz. So by defini- 


E 
tion 


Sf de=lim Iy (f). 
é No 


We show that if a function (zx) nonnegative on a set E is summable 
on that set, then f (x) may tend to -+-co only on a subset of E of measure 
zero. Indeed, set Ey = E [f = +00] and consider that from (8.40) 
and (8.39) (by Properties 4° and 5° of Section 8.4.3) we have a chain. 
of inequalities 


Ty (f)= | (fx (2) a> | (fy (2) de> | N ded Bol. 
E Eo Eo 
* Since for any real a the following set is measurable: 


_fsE{f>a] when a<Q, 
Ely > I=) an empty set when a> WN. 
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But it follows from J (f) > N | £o | that the assumption | £, {> 
> 0 would result in the limit lim Tx (f) being equal ta +o, 


It should be added that any junclion f (z) is summable on a set of 
measure zero. (This fact is obvious.) 

Turning to the general properties of summable functions, first 
note that Properties 2° to 3° established in Section 8.4.8 for bounded 
integrable functions hold for nonnegative summable functions.* 

By way of illustration, we prove Property 3°. From (8.39) we have 
at once the following inequalities: 


(fi) wae (2) > (fe) vp (2) Sh + fe) x @) S (hh) x (2) + (fa) x (2) 


true for any N > O at any point z of a set E. Integrating these 
inequalities over the set L** we establish Property 3° for arbi- 
trary nonnegative summable functions fy and fa. 

Proof of the remaining Properties 2° to 5° for such functions will 
be left to the reader. 

We now proceed to discuss two other fundamental properties of 
arbitrary nonnegative summable functions. 

Theorem 8.17 (complete additivity). Let a set E be a sum of a 
eounialle number of mutually disjoint measurable sets E),, i.e. let E = 


= U. Ey. Then the following two statements are true. 


I. a fa nonnegative function f (x) is summable ona set E, then f{ (zx) 
is summable on every y set ,, with 


oc 


(f(zydz= > { f(xyaz. (8.41) 
z 


k=1 E;, 


Il. Jf a function f (x) nonnegative on a set E is summahle on every 
set E) and if the series on the right of (8.41) converges, then { (z) is 
summable on E too and equation (8.41) is true for it. 

Proof. (1) We first prove Theorems ] and TI for the bounded 
nonnegative integrable function f(r). Let there he a_cons- 
tant Vo osuch that f(7)<M everywhere on FE. Set Ry= 


boo os 


= UY £), and notice that by Theorem 8.8 [/2?,| = > _ Ful 9 
Loon 


tens! 
(as fle eee But then by Properties 4°, 5°, and 1° 
h 
[fepde—D | f(eyde= | fe)dr<M{ dc=[R,|-0 
Ez YY e 


hol Ey, R, R, 





* The constant « in Property 2° must be nonnegative here. 
** We use Properties 5° and 3° for bounded integrable functions. 
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(as n —- co). The last relation proves Theorems I and II for the case 
of the bounded integrable function. 

(2) We now prove Theorem I for an arbitrary nonnegative summa- 
ble function. The summability of f(z) on every EZ, follows at once 


from the inequality | sy (z)dz< ( (f) x (z) dx and from the 


Ey E 
fact that the integral on the left of the inequality is nondecreasing 
in \’. It remains to prove equation (8.41). Using what was proved 
in (1) above and the inequality (f), (7) <f (zx) we get 


| Ox (e)de=D | ee az<y) { feyar. (8.42) 
£ h=1 Ey k=l Ep, 
Proceeding in the last inequality to the limit as NW —oo we have 
5 f(z) <P {f@a (8.43) 
h=1 E;, 


On the other hand, by the properties proved in Section 8.4.3, for 
any m 


Jw @)az= > | ye de> Dy | (Nw (az 
£ 


hai Ep h=1Ly 


and making in the last inequality first VY’ approach oo and only then 
m approach co we obtain the inequality 


frevae>y {4 f(z) dz 


k=l Ep 


which, in conjunction with (8.43), proves (8.41). 

(3) We finally prove Theorem I] for an arbitrary nonnegative 
summable function. Notice that it suffices to establish only the sum- 
mability of f (x) on a set £ (for equation (8.41) will then follow from 
Theorem I we have already proved). 

But summability of f(z) on E follows at once from inequality 
(8.42) and from the convergence of the series on the right of the in- 
equality. The proof of the theorem is complete. 

Theorem 8.18 (absolute continuity of the integral). If f (x) is 
nonnegative and summabie on a set £, then, for any positive e there is 
a positive number 6 such that whatever a measurable subset e of E with 
measure |e | less than 5 may be, 


Si dzr<g. 
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Proof, (1) First let the nonnegative function f(r) be daunded, 
i.e. Jet there be Jf such that f (7) < WV. Then (hy the properties 
established in Section &.4.3) 


(J (2)dr<M(dr=Miel< Mb<e when §< 4. 


¢ € 


(2) We now prove the theorem for an arbitrary nonnegative sum- 
mahle function f (7). On fixing an arbitrary e > 0 we may choase 
(on the basis of the definition of summahility) V = N (e) such that 


{if (@)—U)s dz<s. (8.44) 


E 


Using (8.44) and the inequality (f), (z) << N we get 


( fayde= [if @)—W)x @ da + \ (Ny) <$4-N [ae= 


€ e€ 


H=stN fel e+ Ni<e, 


provided 6< e/2N (ec). Thus the theorem is proved. 

In conclusion we show two more properties true only for nonnega- 
tive summable functions. 

Condition for a nonnegative Summable function to be equivalent 
to zero: If f (x) is nonnegative, measurable and summable ona set E 


and if \ ] (z) ax is equal to sero, then f (x) is equivalent to an identical 


E 
zero on E. 

Proof. It snffices to prove that the measure of the set E [f > OJ 
is equal to zero. We first show that for any a > 0 the measure of a set 
E, = E |f > al) is equal to zero. Indeed, if the measure | £, | were 


positive, we should obtain the inequality ( f(z)dr > \ f(zjdce > 
E E, 


Sak, >0 contradicting the condition { f (4) dx = 0. Now it 
E 
remains to notice that EF [f>O0)= UYU # lf> Wk) from which 
h=l 


it follows that J[EIf>O0lj< =. Elf Wk} | = 0. 


Majorizing criterion for the summahility of a nonnegative measur- 
able function: Jf f,; (x) is nonnegative and measurable on a set 2 and 
fo (x) is summable on E and if f, (x) < fz (7) ts true everywhere on £, 
then f, (x) is also summable on E. 
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of cither of the functions f* (x) and f~ (x) and from the inequalities 
rr (z) < 17 (2) |e f- (ze) SF (x) J it follows, by virtue of the major- 
izing criterion for the “summability of a nOUneE Ne measurable 
function (sce this at the end of Section 8.4.4), ‘that either of the 
functions /* (7) and f~ (x) is summable on L, and this exactly means 
that f(z) is summable on £. 

Thus, for the Lebesgue integral (in contrast to the Riemann inte- 
gral) the integrability of f (x) is equivalent to that of | f (z) |. 

We now consider the properties of arbitrary summable functions. 

Note immediately the validity for arbitrary summable functions of 
Properties 2° to 3° established for bounded integrable functions in 
Section 8.4.3 and for nonnegative summable functions in Section 
8.4.4. That these properties are valid for arbitrary summable func- 
tions follows immediately from equation (8.45) and from the validity 
of the properties for nonnegative summable functions. 

Finally, for arbitrary summable functions the properties of com- 
plete additivity and absolute continuity of the Lebesgue integral still 
hold (proof of these properties for nonnegative summable functions 
made the contents of Theorems 8.17 and 8.18 of Section 8.4.4). We 
give a formulation and some brief hints concerning the proof of 
these properties. 

Theorem 8.17* (complete additivity). Let a set E be a sum of 
a countable number of mutually disjoint measurable sets E),, i.e. let 


E= nC Ey. Then the following two statements are true. 


1. Jf f (x) is summable on E, then f (x) is summable on every set E}, 
equation (8. 41) being true. 

I]. Jf f (2) is measurable and summable on every set E;, and if the 
series 


py { ilaz 
KELb, 


converges, then f (x) is summable on E and equation (8.41) is true. 
To prove Theorem J it suffices to apply Theorem 8.17, J, to the 
nonnegative functions j* (xr) and f- (rz) and use equation (8.45). 
To prove Theorem I] it suffices to consider that by Theorem 8.47, 
II, the function | f (z) | is summable on £. But then so is f (7) and 
equation (8.41) holds by virtue of Theorem J already proved. 
Theorem &.18* (absolute continuity of the integral). If { (x) 
is summable on a set E, then for any positive « there isa positive num- 
ber § such that, whatever the measurahle subset e of FE with measure 


fe | less than §, the inequality | J f(x) dz | <e holds, 
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To prove this it suffices to apply Theorem §.18 to the nonnegative 
function [fj (z) | and use | | f(z) dz |< { |# (2) Laz. 


e e 
8.4.6. Passage to the limit under the Lebesgue integral. 
Definition. It is said that a sequence {j, (z)} of junctions summable 
on a set E converges to a function f (z) summable on the same sei in 


L(E) if 


lim | {fn (z)—7 (z)\de = 0. (8.46) 
Lata -s 


The convergence of {7, (x)} in L (£) ensures the possibility of a term- 
by-term integration of {7, (z)} on £, for it follows from (8.46) 
that lim | #, (x) dx = | 7 (@) az. 
Now a 
Notice that if a sequence {7, (x)} ef junctions measurable and sum- 
madle on a set E converges in L ({£) to a junction 7 (x) measurable and 
summable on E, then {i,, (x)} converges to j (z) also in measure on E. 
Indeed, on fixing an arbitrary ¢ > 0 and denoting by £, a set 
Etlf—f [> el] we have 


bie, 


Ifa (2)—7 ()lda> | 17, (2) —F (Adz Sel Es}. 


so that it follows from (8.46) that }] £, | +0 as nm +o. 

Thus convergence in measure on & is weaker than convergence in 
£ (E) (and, as has already been established, weaker than convergence 
almost everywhere on £). 

We prove, however, that under additional assumptions conver- 
gence in measure on £ will imply convergence in Z (£). 

Theorem §.19 (Lebesgue's theorem). If a sequence {7, (z)} of func- 
tions measurable on a set E converges in measure on E to a function 
j (z) measurable on E and ij there is a function f (x) summable on E 
such that jor all n and almost ail the points of E we have |7, (zt) }< 
< F (z), then {f, (z)} converges to f (xz) in L (E). 

Proof. We first show that the limit function / (x) itself satisfies 
almost everywhere on E the inequality | 7 (z) |< F (a). It follows 
from Theorem §.15 that we can choose a subsequence {f,, (2)} 
(F = 41, 2. ...) of {7, (z)} converging to 7 (z) almost everywhere 
on £. Proceeding in the inequality |7,, (z) |< F (2) to the limit 
as k ~oo we get | f(z) |< F (z) for almost all the points of E. 
From the inequality we have proved and from the majorizing crite 
rion for the summability of a nonnegative measurable function (see 
this at the end of Section §.4.4) it follows that 7 (xz) is summable on F. 
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On fixing an arbitrary e >0O and denoting by £, a set 
Ellf—f, |>e) we have* 


12) —fn(z)ldz= | If (2) Fn (2)ld2+ 


é , 
+ | if@)—fn(elde<2\ P(a)dztel zy. 


EVE, Ep, 


From this inequality and from the arbitrariness of « > 0 it follows 

that to establish the convergence of {f, (z)} to f (x) in L (£) it suffices 

to prove that lim ( F (x) dx = 0; but this follows immediately 
nx 8 

from Theorem 8.18* on the absolute continuity of the integral and 

from the fact that under the hypothesis | E, | +0 as n +09. Thus 

the theorem is proved. 

Corollary (Lebesgue's theorem on passage to the limit under the 
integral). Ifa sequence {f, (x)} of functions measurable on a set E 
converges almost everywhere on E to a limit function f (x) and if there 
isa function F (x) summable on E such that for all n and almost all the 
points of E we have { f, (t) |< F (x), then f (z) is summable on E and 


lim (jf, (2) d2= \f (x) dz. (8.47) 
nace j z 


Proof. It follows from Theorem 8.13 that f (z) is measurable on E. 
Hence it suffices to notice that convergence almost everywhere on E 
implies (by virtue of Theorem 8.14) convergence in measure on £; 
and to use Theorem 8.19. 

Theorem 8.20 (B. Levi's theorem). Let every function {, (z) be 
measurable and summable an a set & and let fy (2) < fn4y (2) for all r 
and for almost all the points of E. Suppose further that there is a con- 


stant AI such that | ( fn (x) dx |< M for alln. Then for almost every 


E 
point xz of E there is a finite limit lim f, (x) =f (zx), the limit 


no 

function f (x) being semmable on FE and equation (8.47) holding. 

Proof. We may assume without loss of generality that all fy (z) 
are nonnegative almost everywhero on £ (otherwise we should take 
the nonnegative functions gy, (t) = fp («) — fy (x) instead of f, (z)). 
Since {f, (z)} is nondecreasing almost everywhere on FZ, a limit func- 
tion f (x) is defined at almost all the points of E taking at them 
either finite values or values equal to --oo. If we prove that limit 
function is summable on £, then it will follow that f (x) has finite 
values almost everywhore on £, i.e. it will follow that {f, (z)} con- 
verges to f (x) almost everywhere on F, and this and the inequality 


* We consider that [f, (z) —f (2) |< 27 (z) almost everywhere on EF. 
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fn () <f (x) (almost everywhere on £) will lead, by virtue of the 
corollary of the previous theorem, to equation (8.47). 

So, to prove the theorem it suffices to establish that the limit 
function f (x) is summable on £. 

Notice that for any N > 0 the sequence* {(f,) y(x)} converges to 
(f)~ (z) almost everywhere on £, the bounded function (f) x (z) 
being summable on £ and (fp) x (x) < (f) wy (x) for all n and almost 
all points of £. 

This ensures the applicability to {(f,) 7 (z)} of the corollary of the 
previous theorem, by which 


lim | (fn)x (2) d2= \ (fy (a) de. 
ae E 


From this and from the inequality** 
[Fn (2) de | (fa)x (2) dz 
E E 

we conclude that 


tim | fn (x) dx > (fx (a) ax, 
eas E 
and since { fn (2) dx < MM for all n, so is 
E 


\ (fx (e) dx<ar. (8.48) 
BE 


From inequality (8.48) and from the fact that the integral on the 
left of (8.48) is nondecreasing in WV it follows that there is a limit 


lim | (f)w (2) de, 
N00 5 


which just means that f (x) is summable on £. Thus the theorem is 
proved. : 
We now formulate Theorem 8.20 in terms of a functional series 
(the theorem is widely used in this form). 
If every function u,, (x) is nonnegative almost everywhere on a set E, 
is measurable and summable on it, and if the series 
fo =) 


S [un (2) dz 


n=1E 





* Recall that for any N > 0 and for any function F (x) we set (F)y (z) = 
= min {N, F (z)}. . 
** This inequality follows from (f,)y (z) = min {N, f, (2). 


1701684 
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converges, then so does almost everywhere on E the series 


oc 


v 

n= 
the sum S (z) of the series (8.49) being summable on E and satisfuing 
the condition 

5 Koad 

\ S§ (xz) dz-= De (x) dx. 

E 2 E 


Uy, (z) ' (8.49) 


Theorem 8.21 (Fatou’s theorem). Ij a sequence {j,, (x)} of functions 
measurable and summable on a set E converges almost everywhere on E 
to a limit function f (z) and if there is a constant A such that 


\ lin (x) |dz <A for all n, then j (x) is summable on E and 


| f(z) | dz <A for it. 


Die Me 


" Proof. We introduce into cwnsideralion functions gg, (z) = 


= inf | f, (z) |* and notice that every function g, (x) is nonnegative 
ha 


and measurable** on E and that the sequence {z, (zj} is nondecreas- 
ing on E and converges to | jf (x) | for almost all points of £. In 
addition, for any n everywhere on £ 


&n (Z) <I fn (2) (5.50) 


from which (by the majorizing criterion for the summahility of «4 
nonnegative measurable function, see this at the end of Section 8.4.43 
it follows that g, (z) is summable on E. Applying to {z,, (zj} Theo- 
rem §.20 we get 


lim |g, (x) dz= { {7 (z)Idz. (S.54) 


Nw 
E 


Since by (8.59) n(x) dx V7 lin (2) | de <A for any n, from 


ad 


E 
(8.51) we get \ } f(z) | dx <A. Thus the theorem is proved. 

8.4.7. Lebesgue classes Lr (E). Recall that a linear space Jt is 
said to be normalized if the following two requirements hold: {4} 
there is a rule by which each element f of # is assigned a real number 
called the norm of that element and designated eater (2);the role 
satisfies the following three axioms: 


* The notation means that for every =z the value of r,, (r) ie the infimum of 


If a Sfnia fz) 1, -- 
2 hat fy (2) ig measurable on E followe from Theorem 5.12. 
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1°. If lin > 0, if FAO, If lle = 0, iff = 0. 

2°. Af ila = 14 4-Il f Ulz for any element f and any real number A. 

3°. For any two elements f and g the so-called triangle inequality 
{f+ella<lf lla + {lg Ile is true. 

We shall consider in a normalized linear space R an arbitrary 
sequence of elements {f,}. 

Definition 1. A sequence {f,} of elements of a normalized linear 
space R is said to be fundamental if 


lim || fm— fr lk = 0. 
men 
n-00 


Definition 2. A sequence {fn} of elements of a normalized linear 
space R is said to converge in R to an element f of R if 


lim |{fn—f lln= 0. 
200 


Such convergence is sometimes called convergence in norm or strong 
convergence in R. 

It is easy to prove that any sequence of elements {f,} converging in'R 
is always fundamental. Indeed, if there is some element f such that 
lf, —f llp ~0 as n oo, then from the triangle inequality 


fm — fn In <M fm —f lle +f — fr Ile 
it follows immediately that 

lim I] tIm—Tillr = 0. 

mE>n ' 

n--oo : 

The question naturally arises as to whether any fundamental 
sequence of elements {/,} is convergent in R to some element f of R. 

Definition 3. A normalized linear space R is said to be complete if 
any fundamental sequence of elements { fn} of R converges in R to some 


element f of R. 

We shall discuss here an important class of normalized linear 
spaces due to Lebesgue and prove the completeness of(these spaces. 

Let a real number p satisfy the condition p > 1. 

Definition 4. We shall say that a function f (x){belongs to the class 
(or space) L? (£) if f (x) is measurable on a set{E and | f (x) |? is sum- 
mable on that set**, 

It is easy to see that for any p > 1 the class L® (£) is a normalized 
linear space if the norm is introduced in it using the relation 


Uf llr) = tf ll>=(f if @rraz)'”. 
; 1E 


—— 
,* Q stands for the zero element of a linear space F. : 
#t We shall not distinguish between functions equivalent on E, regarding 


them as a single element LP (2). 


17* 
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The linearity of such a space is obvious. It is easy to verify Axioms I° 
to 3° using the definition of a normalized space. Axiom 1° follows 
immediately from the condition for a nonnegative summable function 
to be equivalent to zero (see this at the end of Section 8.4.4). Axiom 
2° is quite obvious. Axiom 3° is obvious for p = 4, and for p > 1 
it follows from the Vinkowski* inequality 


({ retem@prar)'’<({ rep as)” + [ie @rrae)"” 
E 


£ E 


established in Supplement { to Chapter 10 of [4]. 

We now prove the following theorem**. 

Theorem 8.22. For any p> 1 the space L” (E£) is complete. 

Proof. Let {f, (z)} be an arbitrary fundamental sequonce of ole- 
ments of the space L? (£). Set 


€n =sup llfm—fn Ilp 
mn 


(the supremum of || fm — fn Ilp is taken over the sot of all m satis- 
fying the inequality m >). It follows from the condition for a 
sequence {f,} to be fundamental that &, --0 as nm ~- oo. It follows 
that we can choose a subsequence of n, (k = 1, 2, ...) such that the 
series** * 


oo 


= (8.52) 


h=t ny, 


converges. 
From the Hélder**** inequality established in Supplement 1{ to 
Chapter 10 of [1] 


(| @)-e@ldz<(f i @yraz)”- | tetarac)™ 
E 


E E 


(p> {,q= oe it follows when p> 14 
* In that supplement the Minkowski inequality has been established for the 
case of the Riemann integral. In the case of the Lebesgue integral it suffices to 
establish this inequality only for hounded functions f(r) and g (r), and for 
such functions the proof is similar to that for the Riemann integral (it is suffi- 
cient to consider a Lebesgue subdivision of the set E). 

** In a special form (relating to the so-called trigonometric system) this 
theorem was proved in 1907 by F. Riesz and independently by Fisher. In {909 
Hermann Wey! noticed that the relation to the trigonometric system is uncs- 
sential and gave the more general formulation (for p = 2) presented here. 

*** It suffices to take n, sttch that tq, < 27%, 

*#*e In that supplement the Hélder inequality has been established for the 
Riemann integral. In the case of the Lebeseue integral it suffices to establish 
this inequality only for bounded functions / (z) and g (z), but for such functions 
the proof is similar to that for the Riemann integral (it is sufficient to consider 
a Lebesgue subdivision of a set EF), 
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[ tfogay @)— fn, EEK fog, (2) fing lle ( 18a)" < 
é 
: eek 

SEn,- {E| P 
and from the last inequality and the convergence of the series (8.52) 
it follows that the series* 


wo 


D | bag. @—fm, I dz (8.53) 
kat E 
converges. From the convergence of (8.53) and from Theorem 8.20 
(see the formulation of the theorem in terms of a series) we conclude 
that the series 


3 
NV 
x=; | Fray (z) Ties (x) ] 
converges almost everywhere on £, and therefore so does the series 
co 
; Si 
fn, (2) +2 (fry, (z) —fn, (x)]. 


But this means that the Ath subsum of that series equal to fp... (2) 


converges almost everywhere on £ to some function f (z). Further, 
since || fm (7) — fn, (2) lp em for any m and any rn, Sm and 
since Ifm (t) — fag (t)] > [fm (7) — f (z)] as k +o almost every- 
where on E, by Theorem 8.21 (Fatou) || 7m (2) —f (2) llp<tm 
(for any m) and this just means that the sequence {/,, (z)} converges 
in Z* (£) to f(z). Thus the theorem is proved. 

8.4.8. Concluding remarks. The central point of the Lebesgue 
theory is closure under the operation of proceeding to the limit in the 
theory of measurable sets (Theorems 8.5 and 8.8). in the theory of 
measurable functions (Theorem 8.13), and in the theory of the integral 
(Theorem &.22). 

We discussed everything for the case of a single variable. In the 
case of mz variables the scheme of constructing the theory remains 
the same, but instead of the interval (a, b) we should take an open 

n 


n-dimensional parallelepiped [] (a, <2x < by) (allowing —oo 
k= 


values for a, and -+co values for b,) to be the original (primary) 
set. In nm dimensions the only qualitatively new feature of the theory 
is the so-called Fubini theorem on reduction of the n-fold multiple 
Lebesgue integra] to an iterated integral of lower multiplicity. We 
shall skip this theorem. 


* We need not use the Hélder inequality when p = 1, for the series (8.53) 
coincides with (8.52). 
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SUPPLEMENT 1 


THE NECESSARY AND SUFFICIENT CONDITION 
FOR RIEMANRN INTEGRABILITY 


Without loss of generality, consider functions defined on a closed interval 
[G, 1}. For every such function f (x) we introduce the so-called Batre functions 
m (z) and Sf (rz) corresponding to the upper and lower limits of f (z) at every 
point z*. So by definition 


m(z)=lim f(y), Mf (z)=Tim { @). 
you yor 
Notice that Baire functions may be defined in another way: 
m(z)= lim finf f(y], Af (z)=_ lim [su : 
(x) Moaee ee 1 (y)) (z) aa le, f (y)] 


where rg (z) is a 6-neighbourhood of a point z (in case z is an end point of [0, 1] 
the right- or left-hand 6-balf-neighbourhood of z respectively should be taken 
instead of the 6-neighbourhood). 

Obviously the function f (x) is continuous af a polnt ro if and only if f (ro) = 
= Im (xq) = M (x9). 

Theorem 8.23. For a function f (r) bounded on [0, 1) to be Riemann integrable 
on [0, 1] it is necessary and sufficient that f (x) should be continuous almost everu- 
where on [0, 4). 

Proof. For any n, divide [0, 1] into 2% intervals a= (Se, x) 


(4 = 1, 2, 3,..., 2%) and introduce into consideration two step functions 7, (z) 
and ©, (z), setting them equal to inf f(y) and sup f(y) at every interval 
al® (n) 
h Sn 
aw) and to zero at points 4/2" (k = 0, 1, ..., 2"). Then on taking for every 


point z = k/2" a sequence of intervals A{™ contracting to z we get 
lim qn (z)=m(z), ‘lim Wp, (z)-= MM (z). (8.54) 
n+0 n-0 





The convergence (8.54) thus occurs almost everywhere on [0, 1}. Since the step 
functions ¢n (z) and ®, () are a fortiori measurable on [0. 1), it follows from 
(8.54) and Theorem 8.43 that so are the Baire functions m (zr) and Jf {z). 
Fram (8.54) we see that almost everywhere on [9, 1] 
lim [pn (z)— Qn (7)] = M (z)—m (2). 
n--w 
From the last relation it follows by virtue of the corollary of Theorem8.19 
that** 


{ { 
tim | fn (=)—@n 2] d= | [AL (2)—m (@)) az, (8.55) 
n= 4 i‘ 


* In case the Sunction7/ (x) is not bounded below (above) in an arbitrarily 
small neighbourhood of z, we set the lower (upper) limit of f (z) equal to 
—oo (0c) at that point. 

** Henceforth al] integrals in Supplement 1 are understood in the sense of 


Lebesgue, 
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It remains to notice that 
1 1 
\ ®py (z) dz=Sp, [ @n (2) dz = Sn5 (8.56) 
0 0 
where S,, and s, ate respectively the upper and lower Darboux sums corresponding 
to the subdivision (A(”) (k = 1, 2, 3, -- + 2”). 
From (8.55) and (8.56) it follows that 


n--0o 


i 
iim (ee j [Mf (2) —m (2)]} az, 
0 


so that (by virtue of Chapter 10 of [4]) a necessery and sufficient condition for 
Riemann integrability reduces to the equation j {Af (x) — m (x)] dx = 0. But 


0 
the last equation, by virtue of the condition for a nonnegative measurable and 
summable function to be equivalent to zero (see Section 8.4.4), means that 
M (2) — m (z) = 0 almost everywhere on [0, 1}. Thus the theorem is proved. 


SUPPLEMENT 2 


THE NECESSARY AND SUFFICIENT CONDITION 
FOR THE LEBESGUE INTEGRABILITY OF 
A BOUNDED FUNCTION 


Theorem 8.24. For a function f (x) bounded on a measurable set E to be Lebesgue 
iad Sea on that set it is necessary and sufficient that the function should be measur- 
able on E. 

Proof. Proof of the sufficiency makes the content of Theorem 8.16, it is 
therefore necessary to prove only the necessity. 

Let a function f(z) be bounded and Lebesgue integrable on a measurable 
set E. This means that the upper and lower Lebesgue integrals of that function 
are equal and there is therefore a sequence of subdivisions 7, = {E{™} of E 
such that the corresponding sequences of the upper sums {S,} and the lower 
sums {s,} satisfy the condition 5S, —s, <1/n, each subsequent subdivision 
T, = {ER} being a refinement of the previous subdivision 7,., = {ER-*}. 
(To construct such a sequence of subdivisions it suffices wherever necessary to 
take a proce of subdivisions to be introduced). 

Recall that by definition 

Sn = SYM) [EL |, sn = Sy mir) EO}, 
R k 
where J{f} and mj™ are respectively the supremum and infimum of f (z) on a se 
Ey, P 

We define two sequences of functions {f,, (z)} and {fp (z)} by setting f, (z) 

equal to 11{) on E{, and fn (z) equal to m@ on EM, : 
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It is obvious that Sor every n the two functions /, (x) and Fr () are measnr- 
able on E (for these functions are linear combinations of characteristic functions 
of measurable sets Ej”). 


It is also obvious that the sequence {7,, (r)} is nonincreasing and tin (xi) is 
nondecreasing on F, with 


fn (2) Sf (2) <fn (2) (8.57) 
for any n at each point of E. Set f(z) = lim f, (z), f (7) = lim f, (+). from 
(8.57) we conclude that sis te 

f(z) Sf (2) <7). (8.58) 


7 (z) and { {z) being measurable on E by virtue of Theorem 8.13, 
From Theorem 8.20 (B. Levi) we get 


lim | tn @)—fn (Mee= | F@)—f Naz. (6.59) 
noe 2 : 


From the definition of the functions f, (z) and fn (z) it follows that 
li (z) —f, (z)) dz = S, —s,, with lim (S, —s,) = 0 by construction, 
. = Noo 
E 
By virtue of (8.59) this leads to the equation \ [f (z) —{(@) dx = 0, 


From the last equation and from the Adntiegativity and measurability of the 
function [f (z) — f (z)] it follows by virtue of Section 8.4.4 that f (zr) — f(z) =0 
almost everywhere on E. Consequently, by (8.58) f (x) = f (x) = f f(x) almost 
everywhere on £, and since jf (z) and j (z) are measurable on E, by Property 4° 
of Section 8.3.2 so is f (z). Thus the theorem is proved. 


CHAPTER 9 


INTEGRALS DEPENDENT 
ON PARAMETERS 


In this chapter we study a special class of functions characterized 
by a common name of “parameter-dependent integrals”. We may get 
an idea of these functions if we integrate a function of two variables. 
x and y with respect to « with every y fixed. As a result we shall 
obviously obtain a function dependent on the parameter y. 

The questions naturally arise as to whether such functions are- 
continuous, integrable and differentiable. These questions are to be- 
studied in the present chapter. 

It is quite clear that integration with respect to the independent 
variable x must not necessarily be proper—if the domain of the: 
function f(z, y) is an infinite band l={axzr<w,cNy< dq, 
then integration with respect to z, with y fixed, is carried out over- 
a half-line and therefore the corresponding integral over the variable- 
z is improper. This leads to the concept of parameter-dependent 
improper integrals. In this chapter we shall study the properties of 
such integrals. 

We stress that throughout the chapter we discuss Riemann, and 
not Lebesgue, integrable functions and that all integrals, whether- 
proper or improper, are understood in the Riemann sense. 





9.4. PROPER INTEGRALS DEPENDENT ON A PARAMETER 


9.1.1. The parameter-dependent integral. Suppose in a rectangle- 
fl={a<z2<b,c<y<qj a function f(z, y) integrable over z 
on the closed interval a <x <b is defined for any fixed y in the- 
closed interval ce <c y <d. In this case on c< y < d the function 


r) 
I(y)= j f(x, y) dx (9.4). 


is defined called the integral dependent on a parameter y. The function 
f (x, y) may be given on a set of a more general form as well. For- 
example, the set D ={a(y)<zr<bd(y), ey <q may serve- 
as the domain of f (z, y). In this case the function of y is defined on. 
[c, d] using relations (9.1) but the limits of integration, a and b, 
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will depend on y. We shall first study the case where the limits of 
integration are constant. 

9.1.2. Continuity, integrability and differentiability of parameter- 
dependent integrals. The following theorems give the answer to the 
above questions. In these theorems II will denote the rectangle 
{fa<irgb,cxay< dh. 

Theorem 9.1. 1f a function f(z, y) is continuous in W1, then the 
function I (y) defined by relation (9.1) is continuous on {c, a). 

Proof. It follows from formula (9.1) that the increment AJ = 
== I (y + Ay) — J (y) of J (y) equals 


b 


Al = \ [f(z, y+Ay)—f (x, y)] az. (9.2) 


a 


Since by the Cantor theorem f (z, y) is uniformly continuous in 1], 
given « > 0 we can find 6 > O such that for all z in {a, bj and all y 
and (y + Ay)in [c, d] such that | Ay | << 6 we have | f (z, y+Ay)— 
— f(z, y) | <e/(b — a). But then it follows from relation (9,2) 
that when | Ay |< 6 we have the inequality | AJ |< e which 
implies that J (y) is continuous at each point y of [c, d]. Thus the 
theorem is proved. 

Theorem 9.2. If f (x. y) is continuous in TI, then I (y) is integrable 
-on [c, d]. Aloreover, 


d d 4 i 4 d 
{ria= (EJ) re, nax]|ay= | ax | fitz, yay. (9.3) 


In other words, under the hypotheses of the theorem @ parameter- 
dependent integral may be integrated with respect to the parameter 
under the integral. 

Proof. By Theorem 9.1 J (y) is continuous on [c, d] and is therefore 
integrable on that interval. The validity of formula (9.3) follows 
from the equality of the iterated integrals occurring in (9.3) (they 


are equal to the double integral ({ f(z, y) dx dy). Thus the 
“Hl 


theorem is proved 
Remark. In (9.3) instead of the upper limit dof integration with 
respect to y we may put any number from the closed interval [c, d]. 


Theorem 9.3. If f(x, y) and its partial derivative of are con- 


tinuous in YI, then I(y) is differentiable on [c, d] and its deriv- 


cative SL can be found from the formula 


hb 
as \ of Ge y) dr. (9.4) 


a 
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{In other words, under the hypotheses of the theorem a parameter- 
dependent integral may be differentiated with respect to the parameter 
under the integral. 

Proof. Consider the following auxiliary function: 


b 

N é ey 

siy) = | AS az, (9.5) 
a 


Since 3 is continuous in II, by Theorem 9.1 g (y) is continuous on 


{c, d| and the integral of the function over [c, y] can be found from 
the formula for integration under the integral. According to the 
remark to Theorem 9.2 we get 


v b v b b 
Je@a= { dz j EON at j f(z, y) dz—~ V7 (2, e)dz. (9.6) 


b b 
Since j f(z, y)dx =I (y) and \ f(x, c) dz =I (c), from rela- 


tion (9.6) we obtain the following representation for I (y): 
u 
Iiy)=) ey atT(c. (9.7) 


As is known, the derivative of an integral with a variable upper 
limit of a continuous function g (?) exists and is equal to the value 
of that function at a point y. Therefore the function J (y) is differen- 


tiable and its derivative 5 is equal to g (y). Turning to formula 


(9.5) for g (y) we see that relation (9.4) is true. Thus the theorem is 
proved. 

9.1.3. The case where the limits of integration depend on a parame- 
ter. We have already said that a caso is possible where the limits of 
integration depend on a parameter. We shall assume that the func- 
tion f (z, y) is given in a rectangle II containing a domain D defined 
by the relations {a ) <z<b(y, ¢<y <q (Fig. 9.4). If for 
any fixed y in {c, d] the function f(z, y) is integrable over z on 
{a (y)], [b (y)], then obviously the following function is defined on 
{c, dj: 

a(y) 
Iy)= | f(% yae (9.8) 
aty) 
which is an integral dependent on the parameter whose limits of 
integration are also parameter-dependent. 
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We shallinvestigate such integrals for continuity and differentiabil- 
ity with respect to the parameter. The following theorems give the 
answer to the above questions, 

Theorem 9.4. Let f (x, y) be continuous on TI and let a (u) and 
b (y) be continuous on {c, d\. Then I (y) defined by relation (9.8) is 
continuous on {c, d]J. 

Proof. Choose an arbitrary yp in [c, d) and represent J (y) as 


b(vo) oy) a(y) 
T= | fe, yldet | fe, y)de— | fix nyde. (9.9) 
a(ve) b(Ye) (Yo) 


Since the first integral on the right of (9.9) is an integral dependent 
on the parameter y, with constant limits of integration and constant 


<—_—— 








z 
Fig. 9.4 


integrand, it is a continuous function of y and tends therefore to 
J (Yo) as y ~> Yo. For the other two integrals we obtain the following 
estimates: 

by) 

[ fem ar 
uve) 
ay) 

| f(z, y) dx 
ave) 
where Af = sup | f (z, y) |. From the last inequalities and from the 
be 


<M IO (y) —B(N0) fs 








<A fa (y)—a (Yo) |, 








continuity of the functions a (y) and b (y) it follows that as y — yo 
the last two integrals on the right of (9.9) tend to zero. Thus the 
limit on the right of (9.9) as y + yo exists and equals J (y,). So 
I (y) is continuous at any point yo of {c, dl, i.e. is continuous on 
[c, d). Thus the theorem is proved. 

We now prove the theorem on the differentiability of the integral 
J (y) with respect to the parameter. 


Theorem 9.5, Let f (&, y) and its derivative ot be continuous in 11. 
Also let a (y) and b (y) be differentiable on {c, d]. Then the function 
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I (y) defined by relation (9.8) is differentiable on |e, d] and its derivative 
I’ (y) is given by the formula 


b(y) 
ry= | acto wow, n—’Wfewsy- — (9-10) 


a(y) 


Proof. Choose an arbitrary yo in {c, d] and represent J (y) in 
the form (9.9). The first integral on the right of (9.9) is an 
integral dependent on the parameter y, with constant limits of 


integration. Since under the hypothesis f(z, y) and sf are con- 


tinuous in II, by Theorem 9.3 the first term is a differentiable 
function at a point yo and the derivative of that function at that 


(Yo) 


point is equal to ( of ©. Yo) 


dx. We prove that the second term 
QC) 

on the right of (9.9) has a derivative at the point y. Since 

that second term vanishes at y= Yo, is suffices to show the exis- 

tence of the following limit: 


"Py 

z, y)dz 

lim 202) (9.41) 
Ura Y—Vo 


which by definition is just equal to the desired derivative. 
We transform the integral in the numerator of formula (9.11). 
From the mean value formula we have 


au) Z 
| f(z, vy dz= F(z, y) (b(y) —b (yo), (9.12) 
blo) 


with z contained between b (yp) and b(y). Substituting the expression 
for the integral from formula (9.12) into the numerator of the ex- 
pression (9.41) and considering that by continuity f(z, y)—> 
— fib (Yo), Yo) a8 ye Yo and SW PGs) 
that the limit (9.11) of interest to us exists and equals 
b' (yo) f (B (Yo), Yo). Reasoning quite similarly wo see that the third 
term on the right of (9.9) has also a derivative at the point Yo 
equal to a’ (Yo) f (4 (Yo), Yo): 

So we have proved that J (y) is differentiable at an arbitrary point 
Yo of [c, d] and that its derivative J’ (yo) is given by formula (9.10). 
Thus the theorem is proved. 

Remark. Theorems 9.4 and 9.5 are also true in the case where 
f(z, y) is given in a domain D alone and satishes in that domain 
the same requirements as in II. 


—>»b' (yo) as Y> Yo We see 
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9.2. IMPROPER INTEGRAL DEPENDENT ON A PARAMETER 


9.2.1. The parameter-dependent improper integral of (hej first kind. 
The uniform convergence of a parameter-dependent improper integral, 
The symbol Ti. will denote a half-band {e<zr<o,c<iy<d}. 

Suppose in IT, a function integrable over z in the improper sense 
on the half-line a< x < oo is given, with any y of [c, d] fixed. 
Under these conditions the following function is defined on Ic, d): 


Ti)= | fle mae (9.13 


which is called an improper integral of the first hind dependent on the 
parameter y. The integral (9.45) is said to converge on the closed 
interval [c, d]. 

In the theory of parameter-dependent improper integrals an 
important role is played by the concept of uniform convergence. 
We shall formulate this notion. 

Definition. An improper integral (9.18) is said to be uniformly con- 
vergent with respect to a parameter y on a closed interval |e, d) if it 
converges on \c, ad) and if given any & > 0 we can find A > a depen- 
dent only on € such that for any R > A and for every y ine, a) 


co 


| i(x, uae 


R 


<e. (9.14) 








We formulate the Cauchy criterion for the uniform convergence of 
parameter-dependent improper integrals. 

Theorem 9.6. For an improper integral (9.13) to converge uniformly 
with respect to a parameter y on a closed interval |c, d] it is necessary 
and sufficient that given any ¢ > Owe should be able to find a number 
A >a dependent only on ¢ such that for any R' and R" greater than A 
and for every y in |e, a) 


Rn 


(f(z, war 


hte 


<€. 








The validity of this criterion follows immediately from the definition 
of uniform convergence. 

Yor applications it is appropriate to point out a number of suffi- 
cient tests for the uniform convergence of parameter-dependent 
improper integrals. 

Theorem 9.7 (Weierstrass test). Let a function f(z, y) be defined 
in I} and integrable orer x on any closed interval (a, R) for every y 
in fe, @). Suppose further that for all the points of Tl. 
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Then the convergence| of \ g (x) dx implies the uniform convergence of: 
a 
the integral (9.18) with respect to y on le, d}. 
Proof. By the Cauchy criterion for the convergence of the integral 


of g (x) (see Theorem 3.1) given any e > 0 we can find A >a such. 
that for all R°> R' DSA 


AR 

\ &(z)dr<e. 

R’ 

Applying inequality (9.15) we get 


R” 
<j g(x)dr<e 
R’ 





a 
f f (x, y) dx 
2 





for every y in [e, dJ. 

This just means that the Cauchy criterion for the uniform conver- 
gence of the integral (9.13) holds. 

Corollary. Let a function p(z, y) definedin a half-band Il. be 
bounded in that half-band and integrable over x on any interval [a, Rl. 
for each y € {c, d]. Then if the integral 


J [h (x) | dx 
a 
converges, then so does uniformly with respect to y on Ic, d) the integral’ 


J @ uh G@) de. 
“To prove this it suffices to put in Theorem 9.7 
f(@, y=9@ W)h(a)s g(2)= Mh (z)|, where M=sup |— (2, ¥)l- 


Note that the Weierstrass test is a sufficient test for the uniform 
convergence of parameter-dependent improper integrals which guar- 
antees their absolute convergence. As in the proof of Theorem 3.4 we 
can establish the following sufficient test for uniform convergence- 
that is applicable to conditionally convergent integrals as well. The 
following statement (Abel-Dirichlet test) is true. 

Let a function f (x, y) be defined in a half-band 1 ., be integrable- 
over x on any closed interval [a, R) for each y € {e, d), and satisfy 
with some constant M > 0 the condition 


| tt y) at] <M. 
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Also suppose that the function g (x) defined for x > a and monotone 
nonincreasing tends to sero as x ~--00. Then the improper integral 


wo 


[ fle, y) g(x) dx 

rs 
converges uniformly with respect to y on {e, dl. 

The next test for uniform convergence relates to integrals of non- 
negative functions. 

Theorem 9.8 (Dini test). Let f (x, y) be a function continuous and 
nonnegative in a half-band Tl and suppose for each y Ele, ad) the 
improper iniegral 


Fi=Jilemaz (9.13) 


converges, 
Suppose further that I (y) is continuous on {c, d}. Then the integral 
(9.13) converges uniformly with respect to y on [c, a). 
Proof, Consider the sequonce of functions 
atn 
In (= J ffx, wae, 
a 
each by virtue of Theorem 9.1 continuous on [c, d]. Since the inte- 
grand f (z, y) is nonnegative, J, (y), being monotone nondecreasing, 
‘converges on Ic, d] to the continuous function J (y). Consequently, 
by Theorem 1.5 (Dini test for functional sequences) the sequence /,,(1) 
convorges to J (y) uniformly on [c, d]. This means that givon any 
# > 0 we can find such that 
oo) 
Ty) iy (y) = \ f(z, y)dzr<e 
o+N 
‘for all y of {c, d] at once. From the nonnogativity of f(z, y) it 
follows that for any R > WN +a and any y € {e, d] 


O< \ f(z, y)dz<e 


se, 3 


This just means that tho integral (9.13) is uniformly convergont. 
Thus the theorem is proved. 

9.2.2. Continuity, integrability and differentiability of parameter- 
dependent improper integrals. The following two theoroms are true. 

Theorem 9.9. Let f (x, y) be continuous in 11, and let the integral 
(9.13) converge uniformly on a closed interval {c, d|. Then that integral 
is a continuous function of y on {e, dl. 
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Proof. Consider the sequence of functions 
a+n 


Inw= J f(a, yaa, 


a 


each by virtue of Theorem 9.1 continuous on [c, d]. Obviously the 
uniform convergence of the integral (9.13) implies the uniform 
convergence to J (y) of the functional sequence J,, (y). In such a case 
the continuity of J (y) follows from Theorem 1.7. 

of 


Theorem 9.10. Let f(x, y) and its partial derivative 2 be 


continuous in Ilo. Suppose further that for some y in {c, a] 
oo 


co 


the integral I (y)= \ f(x, y) dx converges and jz dx converges 
uniformly with respect to y on [c, a]. Under these conditions 
I (y) is differentiable on [c, d] and its derivative I’ {y) can be found 
from the formula 


I*(y) = j jac. (9.16) 


a 


In other words, under the hypotheses of the theorem differentiation 
with respect to a parameter can be carried out under the parameter- 
dependent improper integral. 

Proof. Consider the sequence of functions 


a+n 


I,(w)= J f(@, yaa. 


a 


By Theorem 9.3 each of the functions J, (y) is differentiable on 
[c, d] and 


a+tn 
Iny)= ) HEP ae. (9.47) 


a 


From the hypotheses of the theorem it follows that the sequence 
of the integrals on the right of (9.17) converges uniformly on Ic, d). 
Consequently, uniformly converging to the same limit function is 
the sequence of the derivatives J; (y). Applying Theorem 1.9 we 
obtain equation (9.16). 

We prove a theorem on proper integration of the parameter-depen- 
dent improper integral. 

Theorem 9.11. If the hypotheses of Theorem 9.9 hold, then the 
integral (9.18) can be integrated with respect to the parameter y on 


18—01684 
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a closed interval [c, dj, with 


d d oo on d 
I (y) dy = { dy {f(z y)de= f dz | f(z, y) dy. (9.18) 
c c a a ¢ 


In other words, under the hypotheses of the theorem a parameter- 
dependent improper integral can be integrated with respect to the param- 
eler under the improper integral. 

Proof. Since the hypotheses of Theorem 9.9 hold, the function 
J (y) is continuous on fc, d] and is therefore integrable on [c, d). 
We proceed to prove relations (9.18). 

Using the property of uniform convergence of the integral (9.43) 
we can, for a given e > 0, find A >a such that when 2 > A for 
every y in fe, dJ 

| | fe. nar]< see]. (9.19) 


R 


Assuming further ? > A and using the possibility of inverting the 
order of integration for parameter-dependent improper integrals we 
turn to the following obvious equations: 


oo 


i I (y) dy = { cf f(z, y) det | f(x, y) dz }dy= 


¢ 


i 


atesya 


d ‘ ~ 
dz[ f(z,» dy]+ ay[\ 102, wae]. 
R 


c c 


From these and inequality (9.19) it follows that for all 2 > A 


d R d 
al I (y) dy~ | dz|[ [ f(z, ydy|<e 


ry 


c 


d 
which means that the improper integral dz ( { (z, y) dy over 


Q temeny 8 


a 


the variable «x converges and equals the number \ J (y) dy. Thus 


Oey 


the theorem is proved. 
Remark. Obviously, in relation (9.18) we may substitute for the 
upper limit d of integration any number of the closed interval [c, d]. 
Corollary. Tf f(z, y) is continuous and nonnegative in Tl, and 
the integral (9.13) is a continuous function on fe, d), then formula 
(9.18) ts true. 
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Indeed, under the requirements formulated all the conditions of 
the Dini test for the uniform convergence of the integral (9.13) hold 
(see Theorem 9.8). The statement of the corollary is thus true. 

We now prove a theorem on improper integration of the parameter- 
dependent improper integral. 

Theorem 9.12. Let f (x, y) be continuous and nonnegative when 
z>aand y>c. Also let the integrals 


oo 


I(y)=J t(@, y) de and K (2)= J f (2, ») dy 


c 
be continuous for y >> c and x >a respectively. Then the convergence 
of one of the following two improper integrals 


Fraay= fay f f(x, y)adx and [x (z) dz= fac { r, y) dy 


c 
implies the convergence of the other and equality of the two integrals. 


Proof. Assume that the integral j I (y) dy converges. We must 


prove that the integral j K (x) dx converges and equals i} I (y) dy. 


a c 
In other words, it is necessary to prove that given any e >0 we 
can find A >a such that for R>A 


| {i (y) dy — (K@) dx |<. (9.20) 
0 a 


It follows from the hypotheses of the theorem that given any fixed 
R ><a the hypotheses of the corollary of Theorem 9.14 hold for 
f(z, y) in the half-band {e<r< R,ec<y< oo}. For any R>a 
therefore 


f(z, y) dz. 


Ba yy 


K (x) ee ax | fle, y) dy= fay 


et 


Using these equations and the convergence of the integral j I (y) dy 


c 
we transform the difference under the modulus sign in inequality 
i8* 
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(9.2U). For any # greater than c we write the ee 


x it me ae 
\ ZT (y) du— \ K (2) dz= ( dy \ f(z, y)dz— ( ay | Ven Yy) dre 
ie Swe RS 
=| ay | fe, Waz= | dy \ fe det | aoe y) dz. 
‘ R i R c R 


(9.21) 
We proceed to evaluate the last integrals in relation (9.21). Since 


oo 
under the hypothesis ( I (y) dy converges, given € > 0, we can 
¢ 


find R>e such that 0< | / (y) dy <e/2*. We replace J (uv) 


< | 
R 
in these inequalities by its expression as an integral to obtain the 
wo a 
following inequalities: 0 <{w { f(z, y) dx <e/2. From these 
= a 


and from the nonnegativity of f (x, y) we conclude that for a chosen 
R>cand any R >a 


oo 


0<| ay | fiz, accel. (9.22) 
i 


We now fix 2 as shown above and use the arbitrariness of the choice 


of &. In the half-band {a<2z<0,e<y< R)} the function 
f(z, y) satisfies all the conditions of the Dini test for the uniform 
convergence of improper integrals (see Theorem 9.8). Given e>0 
therefore we can choose A>>a in sucha way that for any R > A and 


oa 


for every y in a closed interval [c, R) we have 0 < ( f(z, yydzr< 


<e/2 (r —c)** from which we obtain the faiosing estimate: 
Roos 
O0<| dy \ f(z, ndr<el2. (9.23) 
- OR 
* The left-hand onc of these inequalities follows from the nonnegativity of 
J (x. vu) when s > aandy Se. 


** The left-hand one of these inequalities follows from the nonnegativity 
of f(r, vy) when 2 >a@ and y >. 
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Turning to the expression (9.21) and estimates (9.22) and (9.23) of 
the last integrals in (9.21) we see that given an arbitrary « > 0 we 
can choose A >a in such a way that for any R >A we have in- 
equality (9.20). This completes the proof of the theorem. 

9,2.3. Parameter-dependent improper integrals of the second kind. 
We introduce the concept of parameter-dependent improper integrals 
of the second kind. Let f (a, y) be a function given in a half-open 
rectangle I] ={a<ir<ib,c<y <q}. Assum that for any fixed 


y in {c, d] the improper integral of the second kind [ f (x, y) dz 
a 
converges. Under these conditions the function 


b 
y=) f@, ydz (9.24) 


is defined on [c, dl called an improper integral of the second kind 
dependent on the parameter y. 

In the theory of such integrals an important role is played by the 
concept of uniform convergence. We shall formulate this notion. 

Definition. An improper integral (9.24) is said to be uniformly con- 
vergent with respect to parameter y on a closed inierval |c, d) if it 
converges for every y in [c, d) and given any ¢ > 0 we can find 6 > 0 
dependent only on & such. that for any o. in the interval O<a<6 
and for every y in [c, a} 


| f (2, y)dz|<e. 


b-a 


For improper integrals of the second kind it is easy to formulate 
and prove theorems on continuity, integrability and differentiability 
with respect to a parameter. 

Note that using the transformations of the variable x in Sec- 
tion 3.2.2 improper integrals of the second kind dependent of the 
parameter y can be reduced to parameter-dependent improper in- 
tegrals of the first kind. 


9.3. APPLICATION OF THE THEORY OF PARAMETER-DEPENDENT 
INTEGRALS TO THE EVALUATION OF IMPROPER INTEGRALS 


The operations on parameter-dependent improper integrals sub 
stantiated in the preceding section allow computation of various 
improper integrals. 

Consider examples of computing and investigating the properties 
of such integrals. 
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1°. Prove that the integral 


I (a) = { e~e« SB ge (9.25) 
‘ 


whose integrand at a point z = 0 is by definition equal to unity 
converges uniformly with respect to @ on a half-line 0 < a < oo. 
We first obtain some estimates. First note that 


e7~°* (asin z-++-cos z) 
1+ a? 


[ e-*sinzdr= — +C=QM(a, z)-+-C. 


Clearly, for a > 0 and x > 0 the function @ (a, x) (antiderivative 
for the fancies e~& sin 2) is bounded: 


JD (a. ZIG tS <2. (9.26) 





Evaluate the following integral: 


[ee Si dz (R>0). 


R 
Integrating by parts for any fixed a >0 we find 


5 sing ] (a, x) jx . ACE M(@, z) 
| | e7 ex AY del = -|[°S* ace Nees dx\< 


1M (a, 22)| 1M (a, z)I 
Se j ar ae dz, 
t 


From this and inequality (9.26) we obtain the following estimate: 
e~ sin 4 = 
[fe ax <P de|< 42 [s =F. (9.27) 


This estimate implies that it integral (9.25) is uniformly conver- 
gent in a@ on 0 <a < oo. Indeed, let e be an arbitrary positive 
number. Choose for that a number A >0 so that 


4 
7s: 


It is clear that then, with R > 1, by the estimate (9.27) for every 
a>0 


fo) 

i sinz 
| \ e~ex 2 dale 
R 
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which implies uniform convergence in @ on the half-line 0 < a < co 
of the integral (9.25) under investigation. 
2°. Use the conclusions just derived to compute the integral* 


in 
Re | SRE ae, (9.28) 


Note in the first place that the integral is the limiting value, as 
a —0 + 0, of the function I (a) defined by relation (9.25). Indeed, 
the integrand in (9.25) is continuous when « > 0 and x > 0 (when 
xz = 0 it is assumed to be equal to unity) and the integral (9.25) 
uniformly converges in a on 0 <a < oo. By Theorem 9.9 therefore 
the integral (9.25) is a continuous function of a on the half-line 
a> 0. It follows that 


oo 


lim I(a)=I= | 222 az, 2 
Jim F(a) | BE de (9.29) 


We obtain for the function J (a) a special representation using which 
we shall find the value of the limit (9.29). That representation is 
obtained from the expression for the derivative J’ («). We must first 
therefore see if it is possible to differentiate the integral (9.25) with 
respect to the parameter « under the integral. To this end we check 
to see if the hypotheses of Theorem 9.43 hold when applied to the 
integral (9.25). It is obvious that the integrand and its partial deriv- 
ative are continuous in @ when a >O and «> 0. We now turn 
to the question of uniform convergence in @ of the integral 


== j em sin x dx (9.30) 
0 


of the partial derivative of the integrand in (9.25). Fix any A > 0. 
Since | e-@* sinz |< e74* for all a >A and since { e4* dz 


0 
converges, by the Weierstrass test (Theorem 9.7) the integral (9.30) 
converges uniformly in a when a > A. Since A is any positive num- 
ber, we can differentiate the integral (9.25) under the integral with 
respect to the parameter « for any a > 0. So when a > 0 


1 


—H AX oy = 
nz = ns 
é si dz 1 z 


I'(a=— 


ot 


Se ee 
* The convergence of the integral under consideration was established in 
Section 3.1.2. 
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Integrating the left- and right-hand sides of the last relations we 
get for « >0 


I(@)=—| ca 


4toqr 





= —arc tana+cC. (9.34) 


sin z 
Ps 








We seek the constant C. Since | 

pression (9.25) we get for e>0 
I (ai< | ee deat 
re a 


0 


<1 when r>0, from the ex- 


from which it follows that 
lim |J (a)| =0, 
Ax 


and therefore 
lim J (a2) =0. (9.32) 


anc 


Since lim arc tana = 2/2, from (9.31) and (9.32) we find that 
a-n 
= n/2. So for a > 0 the function J («) may be represented in the 
following form: 


I (a) = —are tan a. 


From this and from formula (9.29) we evaluate the integral (9.28): 


is] 


(22 gas. (9.33) 


« 


Remark. Consider the integral 


K(a)= | “2% az. (9.34) 
0 
We evaluate this integral] for all possible a. 
We make a change of variables in the integral (9.34) for a > 0, 
setting az = y. Then 








We make a change of variables fora < 0, setting az = —y (y > 0). 
Then 


co 
5 siny nm 
K (a= —f Bh ay=—F. 
0 


o 
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It is obvious that for a = 0 the integra) (9.34) is equal to zero. So- 
oo n/2 when «> 0 
K (a) = [ AY acm 0 when a=0 
0 —xn/2 when a< 0. 
The integral we have considered is commonly called a discontinuous 
Dirichlet multiplier. 
Using the discontinuous Dirichlet multiplier we obtain the follow- 
ing analytic representation of the well-known function sgn @& which 
is usually termed the “oe sign’*: 


~ 


2 
sgn @ a [ 


sinaz 
———— dz 
zx 


9.4. EULER INTEGRALS 


In this section we discuss some properties of important nonelemen- 
tary functions called Euler integrals**. 

A Euler integral of the first kind or ‘beta-function’ is the integral 

a 
B(p, g= | 2”! (1—2)"4 de. (9.35) 
0 

In this integral p and g are assumed to be parameters. If they 
satisfy the conditions p<(4 and q<4, then the integral (9.35) 
is an improper integra] dependent on the parameters p and g, the 
singular points of the integra] being the points z = 0 and z = 1. 

A Euler integral of the second kind or ‘gamma-function’ is the 
improper integral 

T (p)= j e-*xP-h dr. (9.36) 

Q 

Note that evaluating the integral (9.36) we musi take into considera- 
tion that: (1) integration is over the half-line 0 < x < oo, (2) when 
p <1 the point z =0 is a singular point of the integrand (the 
integrand goes into infinity). 

In our discussion we shall] take into account the above peculiarities: 
of the functions B (p, g) and T' (p). We shal] see below that the 
integrals (9.35) and (9.36) converge for p> 0 and g>0. 


* This term is due to the fact that the values of sgn a fora >0, « = 90, 
and «@ <0 equal 1, 0, —14 respectively. ; 

** Vor a detailed account of Euler integrals sce: E.G, Whittaker and! 
G.N. Watson, “A Course of Modern Analysis”. An introduction to the general 
theory of infinite processes and analytic functions; with an account of the 
principal transcendental functions. 4th ed., Cambridge, 1927. 
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9.4.14. The domain of convergence of Euler integrals. We prove 
that the function B (p, g) is, defined for all positive values of the 
parameters p and g and that P (p) is defined for all positive values 
of p. 

We first consider B (p, g). For p >1 and g 1 the integrand 
in relation (9.35) is continuous and the integral on the right of 
(9.35) is therefore proper. Thus B (p, g) is defined for all values of p 
and g mentioned. We now turn to the case where one or both of the 
following inequalities hold: 


O<mp<i,0<g<i., (9.37) 


In this case one or both of the points z = 0 and x = 14 are singular 
points of the integrand. With this in mind we represent B (p, q) 
as follows: 


4/2 1 
Bip. q)= [ xP (Lax) dx-- | ze 8 (f{—2z)@tdzr= 
0 172 
=11(p, +13 (P, 9): 


Obviously, either of the integrals J, (p, g) and J, (p, g) has only 
one singular point. 
1/2 


For the integral 7, (p, q) = | xP — 2x)?! dr the singular 


0 
point is the point z = 0. Noting that on the closed interval [0, 1/2] 
the function (1 — z)%-! is continuous and is therefore bounded by 
some constant C, it is easy to see that the function Cx?! is majorant 
for the integrand of J, (p, g). It follows that J, (p, qg) converges for 
O0<p<i and any gq. Reasoning similarly it is casy to see that 
T,(p, gq) converges for O<qg <i and any p. 

So we have seen that in the case where the inequalities p > 0 
and g > O hold tho integral (9.35) convorges, i.e. the function B (p, 9) 
ts defined for all positive values of p and q. 

We now turn to the function I (p). We have already noted that 
the integral (9.36) has two types of peculiarities: integration over 
a half-line and a singular point z = 0. To separate theso peculiarities 
we divide the domain of integration into two parts so that there is 
only one of those peculiarities in either. For example, we may repre- 
sent P (p) as follows: 


l(p) = 


ste 


en* Ph dz +. ( e“zP! dxz= Ty (p)+1.(p). 
7 


Since | e772?" | <x?) for + > 0, by the partial comparison test 
J, (p) converges when p> 0. The integral 7, (p) also converges 


Ch. 9. Integrals Dependent on Parameters 283 


when p > 0. To show this we can use the partial comparison test 
in the limit form: Jim e-*z’ = U for any r. So we have proved 


x23 0 
that the domain of T (p) is the half-line p > 0. 

9.4.2, The continuity of Euler integrals. We prove that B (p, q) 
is continuous in the quadrant p > 0, g > 0 and that FV (p) is conti- 
nuovs on the half-line p > 0. We first consider B (p, g). To prove 
that it is continuous in the quadrant p > 0, g > 0 it is obviously 
sufficient to show that the integral (9.35) is uniformly convergent 
with respect to the parameters p and g when p> po >) and 
9 == % > | for any fixed positive values of po and gg. Since py — 
~isp—1, ——-t<q—4, for Uri 


PN (J — ale ren h (f — z)t~ 4, 
! 


From these inequalities and from the convergence of {aro —z)ie"! dx 


0 
it follows by virtue of the Weierstrass test that the integral (9.35) 
is uniformly convergent for the indicated values of p and g. Thus 
the continuity of B (pn, q) far p > 0 and g > 0 is proved. 

To prove that T(p) is continuous on the half-line p > 0 it is 
obvionsly sufficient to establish that the integral (9.36) is uniformly 
convergent with respect to p when 0-< py <p <p, for any fixed 
values of poy and p, satisfying the condition 0 < po < py. Since 
for the indicated values of p, py, and p, and for z>0 


enter Pt Sen [xPen tv pPi~ $y, 


the convergence of the integral 
Eo Dd 
( em [xPe-f tri 8) dx 
v 


implies, by the Weierstrass test, the uniform convergence of the 
integral (9.36) for the indicated values of p. Thus the continuity of 
TP (p) for p > 0 is proved. 

9.4.3. Some properties of the function I (p). Here we shall prove 
that T (p) has a derivative of any order. We shall also obtain for 
I (p) a formula called a reduction formula, 

Differentiating [(p) with respect to the parameter under the 
integral we obtain the following integral 


( aP-le* In zdz (9.38) 
0 


which converges uniformly in p on any closed interval0 << py p< 
<p,;. Indeed, the absolute value of the integrand in the integral 


284 Fundamentals of Mathematical Analusis 


(9.38) satisfies on 0 <2 < co the inequality 
JzP-te* In z]< em* [In x] (Po 8 + PS), 
Hence the convergence of the integral 


[ e* In x] (zPo-! + 2Pi-!) dx 
0 


implies according to the Weierstrass test the uniform convergence of 
the integral (9.38). This fact, together with the continuity of the 
integrand in the integral (9.38)* when O0<r< 0, ON<p<o, 
allows us to conclude that it is possible to differentiate T (p) with 
respect to the parameter under the integral. So the derivative I’ (p) 
exists and is equal to the expression (9.38). 

Reasoning similarly it is easy to show that I’ (p) has a derivative 
of any order and that that derivative can be found by differentiating 
with respect to the parameter p under the integral in the expression 
(9.36) for T (p). 

We now proceed to derive a reduction formula for T (p). 

Applying the formula of integration by parts to T (p -+ 4), with 
p> 0. we get 


T(p+i1)= ( zPe~* dx = {—~xPe“*] + p ( x?te-* dx = pV (p). 
9 9 
So for any p>0O 
I (p + 4) = pY (p). (9.29) 


Applying successively formula (9.39) for any p> — 1 and any 
natural 2 we get 


Typ+ti)=p(p—1)... (p—n+it)] P—nt f). (2.40) 
Relation (9.40) is called a reduction formula for TY (p). Using (9.40) 
the gamma-function for values of the independent variable greater 
than unity is “reduced” to the gamma-function for values of the inde- 
pendent variable between zero and unity. 
La 2} 
Since T (4) = jen dz = 1, setting in (9.40) p =n we' get 
Q 
Tin+41)=n(n—1)... 241 =n! 
This formula wil] be used below in deriving the so-called Stirling** 
formula giving an asymptotic representation for nl 
The information obtained for the function T (p) allows us to 
characterize qualitatively the graph of this function. We shall 
* This function is a partial derivative with respect to p of the integrand in 


the expression (9.36) for P(p). 
** Jomes Stirling (1692-1770) is a Scottish mathematician, 
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make a geometrical study of the graph of [ (p) following in the 
main the pattern presented in Section 9.6 of [1]. 

We have established that the domain of [ (p) is the half-line 
O<p<oo. The function [(p) is continuous and differentiable 
any number of times on the half-line, it being possible 1o find any 
derivative by differentiating the oxpression (9.36) for [ (p) with 
respect to the parameter p under the integral. In particular, the 
second derivative I” (p) is 


r"(py= \ x?-t (in x)? e* dx. 

0 
Since I” (p) > 0, the first derivative I’ (p) may have only one zero. 
Since T (4) = 1 2)", by the Rolle theorem that zero of I’ (p) 
exists and is in the interval (1, 2). Since I” (p) > 0, at the point 
where I’ (p) vanishes I (p) has a minimum. Note also that the graph 
of T (p) is convex down. The graph of P (p) has a vertical asymp- 
tote at the point p = 0. Indeed, since [ (1) =1 and [(p) = 
=T(p + 1)/p, the continuity of I (p) at the point 1 implies that 
T (p) + -+0o as p ~0 + 0. Obviously, [ (p)— +00 as p +00. 
Note without proof that the graph of I’ (p) has no_ inclined 
asymptotes. 

9.4.4. Some properties of the function B (p,q). Here we shall 
establish the symmetry properties of B (p, g) and its reduction 
formula. 

We make a change of variable in the integral (9.35), setting z = 
= 1—1. On making the necessary computations we shall see that 


B(p. 9) = Bg, p) (9.41) 


which expresses the symmetry property of the function B (p, q). 
_ We establish reduction formulas for B (p, .g). To do this we turn 
to the function B(p, g +1), assuming p and g to be positive. 
Applying integration by parts and the formula 2? = 2?-t — 
— z?-1 (1 — x) we get 

1 


Bip, +4) = { a? (1—2)tde= . 


ri) 


~[Za-a]+t 2 (Lay d= 


\ {2Pt (4— 2) 4— P14 — aN de= 


ow oo 


(p, )-4B (p, g+4). 


his follows from relation (9.39). 
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From these relations we obtain the following formula: 


B(p. q-+1)= she B(p. 9). (9.42) 
Quite similarly for p >0 and g>0 
B(p+1,q)=>o>B(p, 9). (9.43) 


Formulas (9.42) and (9.43) are called reduction formulas for the 
function B (p, g). Successive application of these formulas reduces 
computing B (p, g) for arbitrary positive values of the independent 
variables to computing B (p, qg) for values of the independent 
variables in the half-open square O< p<i1, O0<qg<1. 

9.4.5. The relation between Euler integrals. We make a change 
of variable in the integral (9.35), setting z= 1/(1 + ¢). As a result 
we obtain for B (p, g) the following expression: 


tq} 


Bip, g)= f ayer ite (9.44) 
0 
Using formula (9.41), along with (9.44) we obtain the following 
expression for B (p, q): 


ip-} 


B (Pp, Q) = \ Gap T dt, (9.45) 
0 


We now turn to the expression (9.36) for I (p). Using the substi- 
tution z = ty, t >> 0, we convert that expression to the form 





r oo 

{) = j ey?! dy, (9.46) 
0 

Replacing in this formula p by p + q and t by 1 + ¢ we get 


co 
D(p+9) _ C o-aty, pegns 
reaper | veer dy. 
0 


We multiply both sides of the last equation by t?"! and integrate 
with respect to t between 0 and oo. Obviously, according to relation 
(9.45) we obtain the formula 


P (p-+9)B(p, q)= {at | yPoyte-ta” dy, (9.47) 
0 69 


If on the right of relation (9.47) we may interchange the order of 
integration with respect to t and y, then, takingfinto account (9.46), 
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we get 


oo 


Pip+q) Bip, N= j yP*I-1eU dy \ 1P~1e-W dt = 
0 0 


= [pero SD ay =P (p) | yet ay =P (p) Pa), 
0 0 


i.e. prove the validity of the formula 


— © (p)-P@) 
B(p, )=FGrg (9.48). 
We shall now show that it is possible to change the order of integra- 
tion on the right of (9.47). To do this it is necessary to verify that. 
the hypotheses of Theorem 9.12 hold. First let p > 1 and g> 1. 
Then obviously the hypotheses of Theorem 9.12 hold. Indeed, 

(1) the function f(t, y) = t?tyP*?-1e-G+tv is nonnegative and 
continuous in the quadrant t>0,y>0. 


(2) The integral i f(t, y) dy = 1? j yPrTe OY dy = 
0 


0 
1 
=e is a continuous function of ¢ for 7>>0. 


(3) The integral { f(t, y)dtsyPte i tP-te-Y dy = T (p)y?te" 
is a continuous Fonelion of y | for y>0. 


(4) The convergence of fay vf f(t, y) dt is established by straight- 
0060 
forward computation. 
So for p > 1 and g>1 formula (9.48) is true. But if only the 
conditions p >0O and g>0 hold, then by that which has been. 
proved 


rT 4)T 4 
B(p-+4, 9+ 1)=—P Ee. 


Using the reduction formulas for B (p, q) and I (p) we again obtain 
from this (9.48). 

9.4.6. Evaluation of definite integrals by means of Euler integrals. 
Euler integrals are well-studied nonelementary functions. A problem 
is considered to be solved if it can be reduced to computing Euler 
integrals. 

Here are some examples offcomputing ordinary and improper 
integrals by reducing them tof‘Euler integrals. 


2285 


1. Compute the integral 


fas \ 2 (1 +2)" dz. 
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Turning to formulas (9.44) and (9.48) we obviously get 


5 By) _ T/A) PQA) _ 4 
T=B(z, q)= ro al (z 
2. Compute the integral 

1/2 


( sin?-! pcos?! ¢ dg. 





)r{ 


33 


a 


i. 


Setting z= sin* g@ we get 
peek a 
rat { 22 (1-2)? de= 
0 
P _- 
40 (4, 4)-4 
2 79 °3 2} ( p+ ) 
2 
3. Consider the integral 
n/2 
a= \ sin?! pd. 
0 
Using the result obtained in Example 2 (it is necessary to set g = 41) 
ave find 
m/2 T (4) 
\ S 4 1 2 
\ sin? i pd °=T7 r (+)—5t7- (9.49) 
° a) 
We further have 
1 eer ee fase to 
ieee vanes Rd Vz, 


‘Setting Vz = ¢ and noticing that | e~? dt equals 1/2 


ry 


i] 


fe- dt we 


0 -~ 
get, according to the example considered in Section 3.4.2 (Poisson 


integral), 
r(f)=va 
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ne de 


Formula (9.49) therefore becomes 
P 
n/2 Vn y ( 2 
4 


| sin?! pdap=-o_ r (244) . (9.50) 
0 


Ipa= 


9.5, THE STIRLING FORMULA 


The term “Stirling formula” is applied to the following asymptotic 


formula: 
nie V gannte™ (1+On)s 


co. 
vie ar wave tee a more general formula describing as pre- 


cisely as desired the bebaviour of the Euler gamma-function for large 
values of the independent variable: 


(9.54) 


rAadti= { pe dt. (9.52) 
0 


To do this we use the so-called Laplace method based on the fol- 


lowing statement. 
a Danie Let f (t) be a function integrable for some a>0 on a closed 


interval [—a, a] and representable as 


Qn—-1 
{()= >) ¢yt*+0 (t"). (9.53) 


h=0 


Then the following asymptotic formula holds: 


1 
¢ noi T{m+—> 
[ e~ MF (i) dt= >> elas 20. (9.54) 
~a m=0 Wane) an + r 


Proof. Substitute relation (9.53) in the integral on the left of 
(9.54) and take into account the fact that the integrals corresponding 
to odd powers of ¢ vanish. To evaluate the remaining integrals it 
suffices to show that for m =>0 


a 


J Men ME dt > “eta) +O (eM) , (9.55) 


19-91684 
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Represent the integral on the left of (9.55) in the following form: 


a wo 
f amerBe de = [ me ae— | ome at, (9.56) 
0 0 a 

Make the substitution z = At° in the first integral on the right 


of (9.56) to get 
4 


co ~ 

~ m- aT 
\ 12-2 dt ———__ \ 2 Zo-* dz = (9.97) 
0 0 


ae 


Further note that for 4 >1 and ti>a 
ent < e~(2~1)ate-t, 


Applying this inequality, evaluate the second integral on the 
right of (9.56) 


oc ceo} 
en M2" dy < e-em ta? f #™e-"* dt = ce-}, (9.58) 
a 


a 


Equations (9.56), (9.57) and the estimate (9.58) yield the required 
formula (9.55), which proves the lemma. 

To apply the lemma make the substitution ¢ = % (4 +2) in 
the integral (9.52). As a result this becomes 


Tid tjaation™’ e~Mx-Indt2)} dz, (9.59) 
4 
Denote by g (z) the following function defined on the half-line 
z>—t: 
g(x) =sgnz-/z—In (1+2). (9.60) 
Then equation (9.59) may be rewritten in the form 


P+ tan tte ( e- hs) dz, (9.64) 
“4 
Our aim is to study the asymptotic behaviour of the following 
integral as 2, -» -+-oo: 
FQ)= { en) dz, (9.62) 


> 
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To do this we consider in more detail the function g (xz) defined 
by equation (9.60). Since 


4 g(a Z(e—n (1+) = 455, (9.63) 


the function g? (x) is strictly decreasing when —1 ~<2< 0 and 
strictly increasing when z> 0. It follows that g (x) is strictly 
increasing on the half-line z > 1, its range of values being the 
entire number line. Further, since g* (x) has in the neighbourhood 
of the point z = 0 the expansion 


g(t) =a—In (1-2) =2—(2-F 40 (2) =F +0(2%), 


there is a function h (x) strictly positive for z > —1 such that 
g? (x) = 2* h (2). 
The function h (x) is infinitely differentiable for z > —4, conse- 
quently so is the function g (z) = x Vh (2). 
ee ne the foregoing one may say that for the function 
= g (zx) defined by equation (9.60) there is an inverse function 
= gy) strictly increasing and infinitely differentiable on the 
entire number line and satisfying the condition g~? (0) = 0. 
Denote that inverse function by z = 9 (y). Using the above pro- 
perties of the function find the asymptotics of the integral (9.62). 
The following theorem is true. 
Theorem 9.13. Let x = @ (y) be the inverse of the function y = g(z) 
defined by equation (9.60). Then for the integral (9.62) the javiounng 
asymptotic formula is true with any n: 


2m+1) (0 m+ 
I()= S w es ) es a) oth (9.64) 
gees oe 


Proof. Fix an arbitrary positive number a and set b = @ (—a), 
c = g (a). This means that a = g (c) = —g (b) and therefore —1 << 
<b<Oandce>0. 

Evaluate the following two integrals 


b © 
T()= J eMererde, Tn (n)— | ender de, (9.65) 


-i1 c 


To evaluate the first integral note that for ~1 << xz < b we have 
g (x) < —a, i.e. g* (x) > a?, and therefore 


e- Ag?(x) < ema’, 
19% 
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In such a case 
b 

1, ()<0er* { dz = (1— |b])e~***, (9.66) 
ot 


The evaluation of J, (4) is similar. For x > ¢ we have g (x) >a, 
ie. g? (z) > @*. Therefore, for 4 >14 and r>e 


e-262(X) me On (Am DEAE BE) ee e~(A~ 1)ate—8*(z), 


From this we get 
Ty(h) < e708 [ erat) dex eye, (9.67) 
: 


From the estimates (9.66) and (9.67) satisfied by the integrals 
(9.65) we obtain for the integral (9.62) the following relation: 


c 


TQ) = \ e-?8®) dz + O (e-28*), (9.68) 
b 


Make a change of variable t = g (z) in the integral (9.68), ic. z = 
= - (t). As a result we get 


TQ)= J e-Mt@! (t) dt +0 (e-*"). (9.69) 
~a 
Since the function gq’ (#) is infinitely differentiable, use the Maclau- 
rin formula to represent @’ (¢) as 


2n-1 
+1 
v= y SPO +o we. 
h=0 , 
To obtain formula (9.64) it remains to apply the lemma to the 
function f (t) = 9’ (¢). Thus Theorem 9.43 is proved. 
In conclusion we describe the following simple way of computing 
pl) (0). From (9.63) we get 


, 2 el) 
28-8 = TT = Saat 





This implies the relation 


{+o() 9,149 
TOTO 
We thus obtain the following equation: 
g(t) gt) = 2t + Qtep (2). (9.70) 


j 4 
Q (t) =r = 28 
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Differentiating successively (9.70) and setting ¢ == 0 we deter- 
mine all ¢” (0). As an illustration, wo evaluate the first three deri- 
vatives of @ (t) at zero. 

On differentiating (9.70) we got 

[p’ (fF + (ft) () = 2 + 2 (tp) + @ (). . (9.74) 

Set t = 0 and consider that @ (0) = 0. Then (0) = 2, ive. 
gp’ (0) = V2. 

After differentiating cquation (9.74) we get 

3p" -p" + peg” = 2 (tp" + 207"). 

On equating t to zero wo get 3 V2 9" (0) = 49, io. @” (0) = 
= 4/3. Similarly from 

Bop"? 4-4" + GQ" fe ep ptY = 2 (1p" +34”) 
wo got op” (0) = 2/3. ; 

Consequently formula (9.64) may he written as 


va Fue), V2 G2) OM) 0.72 

T (a) j = Vv. + 6 aa 42 5. ( ‘ ) 

Substitute equation (9.72) in (9.61) and consider that T (4/2) = 
= Vx, T (8/2) = 4/2F (4/2) = Val2. As a result we get 


arte): (9.78) 


Write out the first five torms of the asymptotic expansion of the 
Euler gamma-function: 


4 Woe 4) 4 

TY (A+ 41) = Vian Ne-*( 4 + ate 
439 54 OU 

— Sr ~ aaa + 3). 








T (A+) = Van e-* (4 + 


Note without proof that the remainder of an asymptotic scrics 
does not exceed the last term retained. 


9.6. PARAMETER-DEPENDENT MULTIPLE INTEGRALS 


9.6.1. Parameter-dependent proper multiple integrals. Let «= 
= (2, Zp, - +s, Sm) be an arbitrary point in a domain D of an 
m-dimensional Euclidean space #™ and let y = (41, Yo. . «+s Yr) 
be a point in a domain Q of a space Z£'. Denote by D X Q a subset 
of an (J + m)-dimensional Euclidean space consisting of al] points 
Zs (24, Zo, +» «y 2Zmyt) SuCh that the point (2), 2, ..., 2m) is in 
D and the point (2mii, Zmter - ++) Zm4z) iS in Q. We shall often 
use the notation z = (x, y)€ D x Q. The closure of a domain D 
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will be designated D. It is easy to see that the closure of D x Q 
coincides with xO, 

Let 7 (x, y) be a function defined in D X Q, the function f (x, yp) 
being integrable over x for any yo € 2 in D. Then the function 


T(y) = \ f(z, y)dz (9.74) 
D 
defined in Q will be called the integral dependent on the parameter y. 


Notice that the parameter y is an /-dimensional vector and the inte- 
gral (9.74) is therefore dependent on / numerical parameters y,, Ya, 


oe Yt 

In close analogy with Theorems 9.9 to 9.12 the following theorems 
are proved. 

Theorem 9.14 (on continuity of the integral (9.74) in the para- 
meter). If f (x,y) is continuous in a collection of independent variables 
in a closed domain D x Q, then the integral (9.74) is a continuous 
function of the parameter y in the domain Q. 

Theorem 9.15 (on integration of the integral (9.74) with respect 
to the parameter). If f (x, y) is continuous in a collection of indepen- 
dent variables in a closed domain D x Q, ihen the function (9. 74) 
can be integrated with respect to the parameter under the integral, i.e. 


[ Fo)dy = [ae] te, 0) ay 
re 


Theorem ne (on differentiability of the integral (9.74) 
with respect to the parameter). If f(x, y) and its partial deri- 


vative a are continuous in DQ, then the integral (9.74) has 


a continuous partial derivative >" in Q, with 
ar _( 4a a, 


Ayn oun 
D 


9.6.2. Parameter-dependent improper multiple integrals. The con- 
cept of parameter-dependent improper multiple integral could he 
introduced, as in the preceding subsection, for the case where the 
integrand } (cz, y) is defined in D X Q, where D c E™ and Qc EF. 
Of the groatest interest, however, is the caso D = 2 to be studied 
here. We shall also assume that f(z, ”) = F (x, y) g (z), where 
F(z, y) is continuous for zy in D x D and g (z) is bounded 
in D. Thus we are considering intewals of the form 


V(y)=f F(z, u) e(a)dz (9.75) 
Dp 
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where the integrand may have singularities for z = y only. We shall 
be concerned with continuity of integrals of the form (9.75) in the 
parameter y. In this connection we introduce the following definition 
of uniform convergence of the integral (9.75) at a point. We shall use 
K (Yo, 5) to denote a ball of radius 6 with centre at a point yp. 

Definition. An integral (9.75) is said to be convergent uniformly 
in the parameter y at a point y, € D if given any e> 0 we can find 
§>0 such that K (Yo, 5) < D and for any cubable domain oc 
< K (yo, §) and each point y € K (Yo, 5) 


| F(x, y)e(z)dx|<e. 


Theorem 9.17. If theintegral (9.75) converges uniformly in y at 
a point yo €D, then it is continuous at the point yo. 

Proof. We want to prove that for any © > 0 there is 6 > 0 such 
that |¥ (y) — V (yo) |< e when | y — yo | <6. From the definition 
of uniform convergence at a point it follows that there is 6, > 0 
such that K (yo, 6;) D and that for y € K (yo, §;) 


[\ Fi, wet) dx | <e/3. (9.76) 
Set 
We \ F(z, y) 8 (x) az, 

- (9.77) 
Vey)= | F(x, v)e (x) dz. 

DIK 
From inequality (9.76) it follows that for | y — yp |< 8, 
Vi (y)| <e/3. (9.78) 


Further note that for x€D\ K (yo, 6) and y € K (yo, §,/2) 
the function F (z, y) is uniformly continuous in a collection of inde- 
pendent variables. Hence there is a positive number 6 < 6,/2 such 
that for ]y —y |< 


\F (z, Yo) a F (z, y) | <e/3af |D lL, 


where Jf is a constant bounding the function g and | D {is the volume 
of a domain D. In such a case for | y — yg | <6 


Vey—Vevl<M | (F(x, y)—F (a, yl dz<el3. 
DN Kiva, 81) 
(9.79) 
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From relations (9.77) to (9.79) it follows that for] y — vo |< & 
LV (vy) — Vo) LIV +I Va (Yo) 1 + IVs (y) — Vs (Yo) I<e. 
Thus the theorem is proved. 

We show one sufficient condition for the uniform convergence 
of an integral at a point that is most commonly occurring in appli- 
cations. _ ~ 

Theorem 9.18. Let F (x, y) be a function continuous in D Xx D 
for x ==y and let g (x) be a function uniformly bounded in D. Sup- 
pose that there are constants 2,0<A<m, and c>0 such that 
for all <€D, yED 

IF (z, y]l<ela—y |. (9.80) 

Then the integral (9.75) converges uniformly in y at each point y,€D. 

Proof, Let yg be an arbitrary point of D. We want to prove that 
given any € > 0 we can find 6 > O such that for any cubable domain 
© < K (Yo, 5) and each y € K (yo, §) 


| j F(z, y) gx) dz |< e. (9.81) 
ay 


Using (9.80) and the condition for the boundedness of g (x) we get 
| { F(x, y) g (2) dz| <ey jc—y|[7* dx. 
o oO 


Fix a pointy € K (yp, 5) and note that the condition w C K (Yo, 5) 
implies the inclusion » c K (y, 28). Hence 

| P(e, we(eazl|<e f  |e—yl*ae. (9.82) 

0 K(u, 26) 


Transforming in the integral on the right of (9.82) to spherical 
coordinates with contre at a point y (see Section 2.5.3°) we get 


26 
-) 

| ( F(z, y) & (2) dz|< Cy [ pis dr = 222 gm = 6,8". 

@ 0 


It follows that on choosing 6 to be sufficiently small we obtain 
inequality (9.841). Thus the theorem is proved. 

9.6.3. Application to Newton potential theory. Suppose a mass mp 
is placed at some point Pp (z, y, 2). By the law of gravitation 
a mass m placed at a point Af (E, 9, €) is acted on by a force 
mma — 

Re” 
where R =p (Po, M) = V(@—tP + (ya FEO v is 
the gravitational constant, and r = #/R is a unit vector whose 





Fou—y 
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direction coincides with that of P,M. Assuming y = 1 and the 
mass m = 1 we obtain the gravitational force 





Salat es 
F= a 
Note that the components of this force are of the form 
X= —F}- E—2), 


Y=——+t-(n—y), 
Z= —2 (6—2). 


It is obvious that the potential of gravitation defined as a scalar 
function u such that F = grad u equals 


— ™o 

ee is 
If the mass is concentrated not at a point Pp» (x, y, 2) but is distri- 
buted over a domain D with density p (x, y, 2), then for the poten- 
tial of gravitation and for the components of gravitation we obtain 
the following expression: 


u én, O= ffl PE bh de dy de, (9.88) 
D 
x=—f j j2S #2 6-2 dex dy dz, 
D 


Ve) lee is eee ee (9.84) 


) 
| 
| 
ae) ae a a dz dy dz. } 


It is not hard to show that the integrals (9.84) are partial derivat- 
ives of the potential (9.83). Since the integrands in the integrals 
(9.83) and (9.84) are majorized by the function C/R*, where % = 1 
for the integral (9.83) and A = 2 for the integrals;(9.84), by Theo- 
rem 9.48 the integrals converge uniformly at every point M (E, , ©). 
Hence, by Theorem 9.17 they are continuous functions of the point 


M (&, n, ©). 


CHAPTER 10 


FOURIER SERIES AND 
FOURIER INTEGRAL 


It is known from linear algebra that if we choose some basis in 
a linear space of finite dimension, thon any element of that space can 
be expanded with respect to that basis (uniquely). 

Far more complicated is the question of the choice of basis and 
expansion with respect to it for the case of an infinite-dimensional 
Space, 

In the present chapter this question is studied for the case of tho 
so-called Euclidean infinite-dimensional spaces and for bases of spe- 
cial form (the so-called orthonormal bases). 

Particular attention is given to the study of the basis formed by 
the so-called trigonometric system in the space of all piecewise con- 
{inuous functions. 

A generalization of the idea of expansion of a function with respect 
to a basis is the expansion to be studied in the presont chapter of 
a function into what is called a Fourier* integral. 

Throughout this chapter the integra] is understood in the Riemann 
sonse. 





10.1. ORTHONORMAL SYSTEMS AND THE GENERAL 
FOURIER SERIES 


In the present section we shall consider an arbitrary Euclidean 
space of infinite dimension*’. For convenience wo give the definition 
of a Kuclidean space 

Definition I. A linear space R is said to be Euclidean if the 
following two requirements are met: 

(4) arule is known by which any two elements f and g of R are as- 
signeda number called a scalar product of those elements and designated 

1 8h 
y & the rule satisfies the following axioms: 
4°. (f, g) = (g, f) (commutative property). 





* Joseph Fourier (1768-1830) is a French mathematician. 
** A linear space is said to be tnjintte-dimenstonal if there is any preuceigned 
number af linearly independent elements in it. 
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2°. (f + g, h) = (f, h) + (g, 2) (distributivity). 

3°. Af, g) = +(f, g) for any real number i 

#2. (7, f>0 Ff fe 0%, (ff, f) = 0 if f=. 

A classical example of an infinite-dimensional Euclidean space 
is the space of all functions piecewise continuous on some closed inter- 
valax<r<b. 

Let us agree throughout this chapter to mean by a function f (z) 
piecewise continuous on a closed interval [a, b] a function such that 
is continuous everywhere on [a, bj, except possibly a finite number 
of points x; (i = 1, 2, ..., m) at which it has a discontinuity of 
the first kind, and satishes at every discontinuity point x; the condi- 
tion 


i- it0 
f@jp— Lecter | (40.1) 


Thus throughout this chapter we require that a piecewise continuous 
function f (x) should satisfy condition (10.4) at every discontinuity 
point x;, i.e. should equal a half-sum of the right- and left-hand li- 
miting values. Note that a condition of the type (10.1) is automat- 
ically true at each continuity point of f (z). 

A scalar product of any two elements f (x) and g (x) of the space 
of all functions piecewise continuous on a <x < b will be defined 
as follows: 


b 
(f =) f@)e@)ae. (10.2) 


There is no doubt that the integral (10.2) of a product of two piece- 
wise continuous functions exists. It is easy to verify that Axioms 1° to 
4° are valid for the scalar product (10.2). Axiom 41° is obvious. Axioms 
2° and 3° follow from the linear properties of the integral. 

We prove the validity of Axiom 4°. Since it is obvious that always 


i, f) = | f° (z) dx >0 it suffices to establish that from (/, f) = 


ry 
e 
6 


{ F (x) dz = 0 it follows that f (x) = 0, i.e. is the zero element 


I} 


a 
of the space under study. Since f (x) is piecewise continuous on 
la, 6], this interval falls into a finite number of subintervals 
{z;.,, v;) on each of which f (x) is continuous**. 


* 0 stands for the zero element of a linear space. 
** The values of f (x) at the end points z;_, and x; of every interval [x;_,, z;] 
are sct equal to the limiting values f (z;.. + 0) and f (x, — 0) respectively. 
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b 
From j f° (z) dz = O it follows that for every subinterval [z;_,, 7,1 
3 


too 
= 
| F(xjdz=0. (10.3) 
*fey 


But from (10.3) and from the continuity of f (z) on [z;,_,, z;] it 
follows that 7 (z)=0 on I[z;_,, z,]*. 

Since the last equation relates to every subinterval and relation 
(10.1) is true at discontinuity points, f (z) = 0 throughout Ia, 8). 
The validity of Axiom 4° is established. 

This proves that the space of all functions piecewise continuous 
on fa, b] is a Euclidean space with scalar product (40.2). 

We establish the following general property of any Euclidean 
space. 

Theorem 10.1. In any Euclidean space, for any two elements f and g 
we have the inequality 


(f, gs <(f, A-(g, g) (10.4) 


which is called the Cauchy-Buniakowski inequality. 
Proof. For any real number 7. 


Gf — 8 hf — ge) DO. 
By virtue of Axioms 1° to 4° the last inequality may be rewritten as 
1°. (f, h) — 2). (f, g) a (g, &£) => 0. 


A necessary and sufficient condition of nonnegativeness of the last 
square trinomial is the nonpositiveness of its discriminant, i.e. 
the inequality 


(, es —(f A- (8, g) <0. (40.5) 


This immediately yields (10.4). Thus the theorem is proved. 

Our next task is to introduce in the Euclidean space under study 
the concept of norm of every element. 

But first we recall the definition of a normed linear space. 

Definition 2. A linear space R is said to be normed if the following 
two requirements are met: 

(4) a rule is known by which each element { of R is assigned a real 
number called the norm oj the element and designated }| jf |\; 

(2) the rule satisfies the following axioms: 


* For it has been proved in Section 10.6 of [1] that if a function is con- 
tinuous, nonnegative and is not identically zero on a given closed interval, then 
the integral of that function over the riven interval is greater than zero. 
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P. WF >O if 740, TF =0 if fH. 


2°. WAS I] = 1% |-IF Il for any element f and any real number i, 
3°. For any two elements f and g we have the inequality 
Iftel<ilflltitell (10.6) 


called the triangle inequality (or Minkowski inequality). 
Theorem 10.2. Any Euclidean space is a normed space if the norm 
of any element f is defined in it by the equation 


Wi=VG A. (10.7) 


Proof. It suffices to show that for the norm defined by relation 
(10.7) Axioms 41° to 3° of Definition 2 are true. 

The validity of Axiom 1° follows immediately from Axiom 4° for 
a scalar product. The validity of Axiom 2° also follows almost im- 
mediately from Axioms 41° and 3° for a scalar product. 

It remains to show the validity of Axiom 3°, i.e. of inequality 
(10.6). We shall rely on the Cauchy-Buniakowski inequality (10.4) 
which we rewrite as 


Mf, QISVEG AV &) 


Using the last inequality, Axioms 4° to 4° for a scalar product and 
the definition of the norm (10.7) we get 


Wtell=Vi+e, f/+O=VEGA+H2¢, OF, OX 
<VG,A+2VG, VE, H+ a= 


—— awe 


=VIVG A+VE Or=aVE N+VE O=Ws i+ tell 


Thus the theorem is proved. 

Remark. There are certainly more ways than one to introducing 
a scalar product (and norm) in every Euclidean space. It is sufficient 
for our purpose in what follows that there is at least one method 
of introducing a scalar product in the Euclidean space under consid- 
eration. On fixing that method, in what follows we shall always 
define the norm of a Euclidean space under consideration by rela- 
tion (10.7). Thus, in the space of all functions piecewise continuous 
on [a, b] (according to (10.2)) the norm is defined by the equation 


b 
wit=V | Fe@az, (10.8) 


a 


and the triangle inequality (10.6) has the form 


b ry ia ale 
Vv ff@+e@pa<) | Pact Vt g?(x)dz. (40.9) 
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We now introduce the concept of orthogonal elements of a given 
Euclidean space. 

Definition 3. Two elements of a Euclidean space, f and g, are said 
to be orthogonal if a scalar product (f, g) of these elements is equal 
to zero. 

Consider in an arbitrary infinite-dimensional Euclidean space R 
some sequence of elements 


Wis Yor - ses Par eee - (40.10) 


Definition 4. A sequence (40.10) is said to be an orthonormal system 
if the elemenis of that sequence are mutually orthogonal and have a norm 
equal to unity. 

A classical example of an orthonormal system in the space of all 
functions piecewise continuous on —a <z<ax is the so-called 
trigonometric system 








4 cos z sing COS nz sin nz ; 
Van’ Va ’ “Wa? seer “Va Vx , 282 © (10.11) 


It is easy for the reader to verify that all the functions (40.11) 
are mutually orthogonal (in the sense of a scalar product (10.2) taken 
for a = —a, b = 1) and that the norm of each of these functions 
(defined by equation (10.7) for a = —a, b = x) is equal to unity. 

In pure and applied mathematics there occur many and various 
orthonormal (on corresponding sets) systems of functions. 


Here are some examples of such systems. 
1°. Polynomials defined by the equation 
1 d® [(z?—4)"] 


Ph Clsrap gee (n=0, 1, 2, ...) 


ate generally called Legendre polynomials. 
It is easy to see that the functions 


waa VEEL. rae) (n= 0, 46% 2) 


formed with the aid of these polynomials constitute an orthonormal (on —1 < 
<2 4) system of functions. 

2°. Polynomials defined by the equations Ty (z) == 1. 7, (z) = 2!-" cos ny 
% (arcens z), with n = 1, 2,..., are called Chebyshev polynomials. Of all n- 
degree polynomials with coefficients of z™ equal to unity the Chebyshev poly- 
nomial 7, (z) has the smallest absolute maximum on —1 <7 < 1. Ut is possible 
to prove that the functions 


ne 


tele 


4 - Tn (2) 


2 ws 
Yo eae Wn O=T7ias (n=1, 2, oe) 


obtained with the aid of Chebyshev polynomials form a system orthonormal on 
—~—1{<ir<l. 
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3°, Of frequent use in probability theory is the so-called Rademacher* system 
Yn (z)=@ (27-2) (n=0, 1, 2, ...), 


where 9 (?) = sgn (sin 272). 

It can be proved that this system is orthonormal on a closed interval0 <2 < 1. 
4°. Of use in a number of investigations in function theory is the so-called 

Haar** system which is orthonormal on 0 < z < 1. Elements of this system 

7k,, (z) are defined for alln = 0,1,... and for all & taking on values of 1, 2, 4,..- 


>... 2% They are of the form 











ie 2k—2 2k—-1 
Von when Par <2< ntl 9 

wh) oes 2k—41 2k 

dn = (2) — V2" when pr StS par» 





0 at the other points of {0, 4]. 


Every Haar function is a step of the same form as the function Y 2 sgn x 
on aclosed interval [—2-("*}), 2-("+2)]. For every fixed x increasing k moves that 
step to the right. Everywhere outside the corresponding step every Haar function 
is identically zero, 


Let an arbitrary orthonormal system of elements {i} be given 
in an arbitrary infinite-dimensional Euclidean space R. Consider 
any element f of R. 

Definition 5. The Fourier series of an element f with respect to an 
orthonormal system {py} is a series of the form 


yates (40.12) 


where f, are constant numbers called Fourier coefficients of the element 
f and defined by the eguations 
fh =(f. De), &#=1,2,... 


It is natural to call a finite sum 
n 
Sn= 2 tats (10.13): 
the nth partial sum of a Fourier series (10.42). 


Consider along with the nth partial sum (10.13) an arbitrary linear 
combination of the first z elements of an orthonormal system {%p,} 


n 
2 nite (10.14) 
with any constant numbers C,, Cy, ..., Ch. 


We shall show what distinguishes the nth partial sum of a Fourier 
series (10.13) from all the other sums (10.14). 





* Wf. Rademacher (b. 1892) is a German mathematician. 
** Alfred Haar (1885-1933) is a Hungarian mathematician. 
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Let us agree to call || f — g || @ deviation of g from f (in the norm 
of a given Euclidean space). 

The following main theorem holds. 

Theorem 10.3. Of all the sums of the form (10.14) it is the nth partial 
sum (10.13) of the Fourier series of an element f that has the smallest 
deviation from f in the norm of a given Euclidean space. 

Proof. Taking into account the orthonormality of {p,} and using 
the axioms of a scalar product we may write 


n n n 
I s Ci, —f ll? oz ( = Cin —f, pa Cr, —f) = 
k=} h=4 h=1 


= SCR Pa 2 2 Onl WA N= 


nr n n n 
= co—2 N Cafp HAPS SS (Ca—th2— SRE TIP 
1 h=1 k=l h={ 


k= 


Thus 
“ 20 A 
LS Cote flP= S (Cafe SS fi (10.15) 


The left-hand side of (10.15) involves a squared deviation of the 
sum (10.14) from f (in the norm of a given Euclidoan space). It 
follows from the form of tho right-hand side of (40.45) that that 
squared deviation is the smallest for C,, = f, (for the first sum on 
the right of (10.45) vanishes and the other terms on the right of 
(40.15) are independent of C,). Thus the theorem is proved. 

Corollary 1. For an arbitrary element f of a given Euclidean space 
and any orthonormal system {xp,} under an arbitrary choice of constants 
C;, for any n 


n n 
WAP S f<l] S Cute —F iP. (10.46) 
Inequality (10.46) is an immediate consequence of the identity 


(10.45) 


Corollary 2. For an arbitrary element f of a given Euclidean space, 
any orthonormal system {,} and any n 


n n 
IS tems lP=fie — Sp. (10.17) 
hoi h=at 


This is often called the Bessel* identity. 
To prove (10.417) it suffices to set Cy, = fy, in (10.45). 


* Friedrich Wilhelm Bessel (1784-1846) is a German astronomer and mathe- 
matician. 
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Theorem 10.4. For any element f of a gwen Euclidean space and 
any orthonormal system {\p,} we have the following inequality: 


“18 


fie <i flr (10.18) 


3 
Ml 
a 


called the Bessel inequality. 
Proof. From the nonnegativeness of the left-hand side of (10.47) 
it follows that for any n 


Py fR<IFIP- (40.19) 


But this means that the series of nonnegative terms on the left of 
(10.48) possesses a bounded sequence of partial sums and is therefore 
convergent. Proceeding in inequality (10.19) to the limit as n > oo 
(see Theorem 3.13 in [1]) we obtain inequality (10.18). Thus the 
theorem is proved. 

As an illustration consider the space of all functions piecewise 
continuous on a closed interval —x <2< a and, in that space, 
a Fourier series with respect to the trigonometric system (10.11) 
(it is customary to call that series Fourier trigonometric series). 
For any function f (rz) piecewise continuous on —x <z< 70 that 
Fourier series has the form 








eof zy coskz , = sinks 


where Fourier coefficients f, and ra are defined by the formulas 


Tu 





h=ae Silas, 
have f 1 (2) cos ke az, h= ye | f(@)sin ke de 


(had, 2D). 


The Bessel inequality true for any function f (x) piecewise conti- 
puous on —% <2z< 7 has the form 


i+ > G+ < J Paz. (10.24) 
k=1 ~1 


2001684 
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In this case the deviation of f (xz) from g (z) in the norm is equal 
to the so-called root-mean-square (or standard) deviation 


on 
tf 
Wf-el= Vo | ¢@)—e@ees. (10.22) 
rad 
In the theory of Fourier trigonometric series, however, a somewhat 
difierent notation for both the Fourier series (10.20) and the Bessel 


inequality (10.24) is used. It is the Fourier trigonometric scrics 
(10.20) that is usually written as 











o+ 2a cos kx b, sin kz), (10.20') 
k= 
where 
2 4 f 
— A =e 
= GE=a Ji eax, 
ih _ 4 
— Bir oh If 
a, = ae yi (z) cos kz dz, (10.23 
= 1 x 
ho in Je 
by, = tae j f (x) sin ka dx 


With this notation the Bessel inequality (10.21) becomes 


aT 
HD ait <t | pw@rde. (10.21’) 

is k~! “nt 

Remark. It follows from the Bessel inequality (10.21') that for 
any function f (x) piecewise continuous on —x <r <a the quan- 
tities a, and b, (called Fourier trigonometric coefficients of f (z)) 
tend to zero as +} + oo (by the necessary condition for convergence 
of the series on the Jeft of (10.24’)). 


10.2. CLOSED AND COMPLETE ORTHONORMAL SYSTEMS 


As in the preceding section we sha) consider an arbitrary orthonor 
mal system {y,} in any infinite-dimensional Euclidean space 2, 
Definition 1, An orthonormal system {x})) is said to Le closed if for 
any clement f of a given Euclidean space R and for any positive number t 
there is a linear combination (10.14) of a finite numler of elements of 
{y,} such that its deviation from f (in the norm of Jt) is less than e. 
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In other words, a system {ip,} is said to be closed if any element f 
of a given Euclidean space R can be approximated in the norm of 
that space to an unlimited precision by linear combinations of a finite 
number of elements of {1p,}. 

Remark 1. We drop the question of whether there are closed ortho- 
normal systems in any Euclidean space. Note that in Chapter 14 
westudy an important subclass of Euclidean spaces, the so-called 
Hilbert spaces, and establish that there are closed orthonormal 
systems in every such space. 

Theorem 10.5. If an orthonormal system {p,} is closed, then for 
any element f of a given Euclidean space the Bessel inequality (10.18) 
goes over into an exact equation 


2, R= IFIP (10.24) 


called Parseval’s* formula. 

Proof. Fix an arbitrary element f of the Euclidean space under 
consideration and an arbitrary positive number e. Since the system 
{t),} is closed, there is nm and numbers Cy, Cy, ..., Cy such that 
the square of the norm on the right of (10.16) is less than e. By 
virtue of (10.16) this means that for an arbitrary e > 0 there is 
n for which 


i lnaage 2 fi<e. (40.25) 


For integers greater than that n inequality (10.25) is clearly true, 
for the sum on the left of (10.25) may only increase as n increases. 
So we have proved that for an arbitrary ¢ > 0 there is n beginning 
with which inequality (10.25) is true. 
In conjunction with inequality (10.49) this means that the series 


> ff converges to the sum || f ||?. Thus the theorem is proved. 
k=l 


Theorem 10.6. If an orthonormal system {xp,} is closed, then what- 
ever the element f the Fourier series of that element converges to it in 
the norm of the space under consideration, i.e. 


limn || 2 frtta—f ]=0. (410.26) 


Proof. The statement of this theorem follows immediately from 
equation (10.17) and from the preceding theorem. 

Remark 2. In the space of all functions piecewise; continuous 
on a closed interval —n < x < x convergence in the norm (40.26) 


* M. Parseval (d. 1836) is a French mathematician. 
20* 
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turns into convergence in the mean on that interval (see Section 4.2.3). 
Thus, if the closure of the trigonometric system (10.41) is proved, 
Theorem 10.6 will state that for any function f (x) piecewise contin- 
uous on —t M2z<—_u the Fourier trigonometric series of that func- 
tion converges to it on —2 aoa in the mean. 

Definition 2. An orthonormal system {ip} is said to be complete 
if besides the sero element there is no other element f of a given Euclidean 
space that would be orthogonal to all the elements rp, of {pn}. 

In other words, a system {ip,} is said to be complete if any ole- 
ment f orthogonal to all the elements yp, of {rp,} is a zero element. 

Theorem 10.7. Any closed orthonormal system {1p,} is complete. 

Proof. Let a system {p,} be closed and let f be any element of 
a given Euclidean space orthogonal to all the clements 1p, of {ip,}. 

Then all Fourier coofficients f, of f with respect to {ip,} are zero 
and therefore, by Parseval’s formula (10.24), [| f [| = 0 too. The 
last equation (by Axiom 4° for the norm) implies that f = 0. ‘Thus 
the theorem is proved. 

Remark 3. We have proved that in an arbitrary Euclidean space 
the closure of an orthonormal] system implies its completeness. In 
Chapter 14 an example is given showing that in an arbitrary Eucli- 
dean space the completeness of an orthonormal system does not 
in general imply its closure. It is also proved there that for a very 
important class of Euclidean spaces, the so-called Hilbert spaces, 
the completeness of an orthonormal system is equivalent to its 
closure. 

Theorem 10.8. For any complete (and clearly for any closed) or- 
thonormal system {1p} two distinct elements f and g of a given Euclidean 
space cannot have the same Fourier series. 

Proof. If all Fourier coefficients of f and g coincided, then all 
Fourier coefficients of the difference f — g would be zero, i.e. the 
difference 7 — g would be orthogonal to all the elements +p, of a com- 
plete system {ip,}. But this would mean that f — g is a zero element, 
i.e. that the elements f and g coincide. Thus the theorem is proved. 

This completes our discussion of the general Fourier series with 
respect to an arbitrary orthonormal system in any Euclidean space. 

Out next goal is to make a detailed study of the Fourier serics 
with respect to the trigonometric system (10.41). 


10.3. THE COMPLETENESS OF THE TRIGONOMETRIC SYSTEM. 
COROLLARIES 


10.3.1. Uniform approximation to a continuous function by trigono- 
metric polynomials. We shall establish here the closure (and there- 
fore completeness) of the trigonometric system (10.11) in the space 
of all functions piecewise continuous on a closed interval —xn Kz< 
<x. But before proving tho closure of the trigonometric system 
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we shall establish an important theorem on uniform approxima- 
tion to a continuous function by the so-called trigonometric po- 
lynomials. 

A trigonometric polynomial is an arbitrary linear combination 
of any finite number of elements of the trigonometric system (40.114), 
ie. an expression of the form 


T ()=Cy geet (C;, cos kx a eran sin kz), 


where n is any integer and C, and C; (k = 1,2, ..., m) are ar- 
bitrary constant reals. 

Note two quite elementary statements: 

4°. If P (a) is any algebraic polynomial of arbitrary degree n, then 
P (cos z) and P (sin x) are trigonometric polynomials. 

2°. If T (x) is a trigonometric polynomial, then either of the expres- 
sions T (x)-sin xz and T (x)-sin® xz is a trigonometric polynomial. 

Both statements follow from the fact that the product of two 
(and therefore of any finite number of) trigonometric functions* 
of z reduces to a linear combination of a finite number of trigono- 
metric functions of independent variables of the type kz (see this 
for yourself). 

In the theory of Fourier trigonometric series an important role 
is played by the concept of periodic function. 

A function f (x) is said to be a periodic function with period T if: 
(1) f (2) ts defined for all real x; (2) for any real x 


fl@+T) =f (2). 


This equation is usually called periodicity condition. Considera- 
tion of periodic functions results from the study of various oscil- 
latory processes. 

Note that all the elements of the trigonometric system (40.41) 
are periodic functions with period 2x. 

The following main theorem is true. 

Theorem 10.9 (Weierstrass). If a function f (x) is continuous on 
a closed interval |—n, x] and satisfies ihe condition f (—x) = f (x), 
then it can be uniformly approximated on [—n, x] by trigonometric 
polynomials, i.e. for this function f (xz) and for any positive number e 
there is a trigonometric polynomial T (x) such that for all z in 
[—x, x] at once 


lf@—T@i<e. (10.27) 
Proof. For convenience we carry out the proof in two steps. 


4°, First suppose additionally that f (x) is even, i.e. satisfies the 
condition f (—z) = f (x) for any z in [—x, al. 





* In this case we mean cosine and sine by trigonometric functions. 
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By the theorem on the continuity of the composite function y = 
= f(z), where z = arc cost (see Section 4.7 of [1]), the function 
F (t) = f (arc cos ¢) is a continuous function of the independent va- 
riable t on a closed interval —1 <t<1. Therefore by the Weier- 
strass theorem for algebraic polynomials (see Theorem 1.18) given 
any ¢ >0 we can find an algebraic polynomial P (t) such that 
| f (arc cos t) — P (t) |<Ce at once for all fin —1 <t<i. 

On letting t = cos x we get 


|f (x) — P (cosz) |<e (410.28) 


at once forallzinOSar<u. 

Since both functions f (z) and P (cos 2) are even, inequality (40.28) 
is true for all x in —n <z<0, too. Thus (10.28) is true for all z 
in —xt <a# <1 and since (by Statement 1° above) P (cos z) is a 
trigonometric polynomial, this proves the theorem for an even func- 
tion f (z). 

Now note that a function f (x) satisfying the hypotheses of the 
theorem being proved can be, poriodically with period 2n, extended 
to tho whole infinite straight line —coo<2< oo, so that the extend- 
ed function will bo continuous at each point z of the line. If f (z) 
is extended in this way, then since P (cos z) is also a periodic function 
of period 2x, wo find that for an even function f (x) inequality (10.28) 
is true everywhere on an infinite straight line —00 <x <0. 

2°. Now let f (x) be an entiroly arbitrary function satisfying tho 
hypotheses of the theorem. We oxtend it periodically with period 
2x to the whole infinite straight line and form with the aid of it the 
following two even functions: 


fi (j= Lbs (40.29) 
fs (2) = LGN U2) sin Le (10.30) 


By what was proved in 4°, for any e > 0 there are trigonometric 
polynomials 7, (z) and 7, (z) such that everywhere on the infinite 
straight line 
Ih (2) — Ti (2) |<el4, [fe (2) — Ts (2) |<el4, 

and therefore 

[fs (2) sin? z— 7, (x) sin? z| < &/4, 

|f.(z) sin z—~T, (x) sinz| <e/4. 
Adding together the last two inequalities, considering that the modu- 
lus or absolute value of the sum of two quantities is not greater than 


the sum of their moduli and taking into consideration equations 
(10.29) and (10.30) we see that everywhere on the infinite straight 
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line 
|f (x) sin? zx —T'3 (x)| <e/2, (40.34) 


where 7’, (x) is a trigonometric polynomial equal to 7's (x) = T; (t)X 
Xsin? z -+ T, (x) sin x. 

Instead of f (x) in the above discussion we can take a function 
f(z + n/2)*. In full analogy with (10.31) we shall have that for 
f(c + 2/2) there is a trigonometric polynomial 7, (z) such that 
everywhere on an infinite straight line 


\f (v-++-0/2) sin? 2z—T, (x)| < 8/2. (10.32) 


Replacing in (10.32) z by x — x/2 and denoting by 7, (x) a trigo- 
nometric polynomial of the form 7; (x) = 7, (c — 1/2) we see that 
everywhere on an infinite straight line 


\f (z) cos? c—T'; (z)| < 0/2. (10.33) 


Finally, additing together inequalities (10.31) and (410.33) and 
denoting by 7 (z) a trigonometric polynomial of the form T (zt) = 
= T, (z) + T; (z) we see that everywhere on the infinite straight 
line inequality (10.27) is true. Thus the theorem is proved. 

Remark. Each of the conditions, (1) the continuity of f(z) on 
{—n, x], (2) the equality of f (—m) and f (x) in value is a necessary 
condition for f (x) to he uniformly approximated on —n SG tQu 
by trigonometric polynomials. 

In other words, the Weirstrass theorem can be restated as follows: 
for a function f (z) to be approximated uniformly on a closed interval 
{—n, x] by trigonometric polynomials, it is necessary and sufficient 
that f (x) should be continuous on {—x, x] and satisfy the condition 
f(—n) = f (x). 

Sufficiency makes the content of Theorem 10.9. 

We shall prove the necessity. Let there be a sequence of trigono- 
metric polynomials {7, (z)} converging uniformly on [—x, x} to 
f (x). Since every function T,, (x) is continuous on {—x, 1], so is 
f(z), by Theorem 1.8. Given any © > 0 we can find a polynomial 
T,, (x) such that | f(z) — T, (x) |<e/2 for every z in [~z, x}. 
Therefore 2 


| f(—2) — Tr (—m) |<e/2, If (x) — Tr (a) |< e/2. 


From the last two inequalities and from the equation 7, (—x) = 
= T,, (x) following from the periodicity (with period 2x) condition 
we conclude that | f (—x) — f (m) |< e whence f (—x) = f (x) (by 
the arbitrariness of ¢ > 0). 

10.3.2. The proof of the closure of the trigonometric system. Relying 
on the Weierstrass theorem we prove the following main theorem. 


* For this function satisfies the same conditions as jthe extended jfunction 
f (z) does. 
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Theorem 10.10. The trigonometric system (10.11) ts closed’, i.e. 
for any function f (x) piecewise continuous on a closed interval 
{[—zx, x] and any positive number e there is a trigonometric poly- 
nomial 7 (z) such that 


Wi@—Tai=V Jr@—reprar<e. (10.34) 


Proof. First of all note that for any function f (z) piecewise con- 
tinuous on [—a, a] and for any ¢ > 0 there is a function F (zx) con- 
tinuous on [—x, a], satisfying the condition F (—a) = F (x) and 
such that 


Wf (x) ~F (2) J= Vv \ {f (2) — F (2)? dz < e/2. (10.35) 


Indeed, it suffices to take the function F (x) to coincide with 
f(z) everywhere except sufficiently small neighbourhoods of the 
discontinuity points of f (x) and ofJthe point z = a and to take F (z) 
to be a linear function in those neighbourhoods so that F (x) is con- 
tinuous throughout [—a, a] and satisfies F (—x) = F (x). 

Since a piecewise continuous function and the linear function 
completing it are bounded, choosing those neighbourhoods of the 
discontinuity points of f (x) and of the point z = x to be sufficiently 
small ensures that inequality (10.35) holds. 

By the Weierstrass theorem 10.9, given a function F (x) we can 
find a trigonometric polynomial T (x) such that for every zin{—a, a] 


| F (2) — T (2) |< ¢/2V On. (40.36) 
From (10.36) we conclude that 


fee 
F(2)—T (a= V/ j [F (x) —T (x)}2dz<e/2. (10.37) 


7 


From (10.35) and (10.37) and from the triangle inequality for the 
norms 


Wi@)—-Te|I<N/M—-F@IFAIFE@—-—TEe)1 


we obtain inequality (10.34). Thus the theorem is proved. 
Remark 1. From Theorems 10.10 and 10.7 it follows imme- 
diately that the trigonometric system (410.414) is complete. Fiom 


this in turn it follows that the system {/ = sin nz} 


* And therefore (by Theorem 10.7) complete. 
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(n=1,2,...) is complete on the set of all functions piecewise 
continuous on a closed interval [0, x] (or respectively on [—, OJ). 
Indeed, any function f(x) piecewise continuous on [0, x} and 
orthogonal on [0, zx] to all the elements of the system 


{7/2 sin nz} turns out to be orthogonal on [{—a, x] to all 


the elements of the trigonometric system (10.11) after an odd 
extension to [—, 0]. By the completeness of the system (10.11) 
that function is zero on [—x, x] and Mheretore\on {0, =]. Quite 
similarly it can be proved that the system ara V = cosnzx 
(n=1,2,...) is complete on the set of all functions piecewise 
continuous on [0, 1] (or respectively on [—3, Q)). 


Remark 2. It can be shown that of the orthonormal systems indicated in 
Section 10.1 those formed using Legendre polynomials, Chebyshev polynomials 
and Haare functions are closed systems and the Rademacher system is not. 


10.3.3. Corollaries. 
Corollary 1. For any function f (x) piecewise continuous on a closed 
interval |—x, x] Parseval’s formula 


B43 ht H= = | Paz (10.38) 


h={ 


holds (this follows from Theorem 410.5). 

Corollary 2. The Fourier trigonometric series of any function f (x) 
precewise continuous on [—x, 1] converges to that function on |—n, a) 
in the mean (this follows from Theorem 10.6 and Remark 2 to it). 

Corollary 3. The Fourier trigonometric series of any function f (x) 
piecewise continuous on [—n, x] can be integrated term by term on 
{—nx, x] (this follows from Corollary 2 above and from Theorem 1.11). 

Corollary 4. If two functions f (x) and g (x) piecewise continuous on 
{[—x, x] have the same Fourier trigonometric series, then they coincide 
everywhere on [—x, x} (this follows from Theorem 10.8). 

Corollary 5. If the Fourier trigonometric series of a function f (x) 
piecewise continuous on [—nx, x] converges uniformly on some closed 
interval [a, b] contained in [—n, x] then it is to the function f (x) 
that wt converges on la, 0). 

Proof, Let F (x) be the function to which the Fourier trigonometric 
series of f (z) uniformly converges on [a, ¥]. We prove that F (2) == 
== f(z) throughout [a, b}. Since uniform convergence on la, 5} 
implies convergence in the mean on it (see Section 1.2.3), the Fourier 
trigonometric series of f (x) converges to F (z) on [a, b] in the mean. 
This means that for an arbitrary e > O,Ahere is n, beginning wi ' 
which the zth partial sum of the Fourie £  nometric series S 


io 
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satisfies the inequality 





{e 
HFS, (a= |/ SIF @—S, (mRer<el2. (10.39) 


On the other hand, by Corollary 2 the sequence S, (z) converges 
to f (z) in the mean throughout [—2, 2] and therefore on [a, b] too, 
i.e. for the fixed arbitrary e« > 0 there is ny beginning with which 





a) 
IS.c—fMI= VV | 1S. @—FWRdr<eld (10.40) 


From (410.39) and (10.-0) and from the triangle inequality 


WF @)-fF@W<IF@®—-Sr,@U+15, 0 —-FO Hl 


it follows that || F (7) — f (x) |] <s. From tho last inequality and 
from the arbitrariness of ¢ > 0 it follows that j| F (7) — f (2) || =0 
and from this on the basis of Axiom 1° for the norm we conclude that 
F (x) — f (x) is the sero elemeni of a space of functions piecewise con- 
tinuous on la, b], ie. a function identically zero on fa, bJ. Thus 
Corollary 5 is proved. 

Remark {. Of course, in Corollary 5 the closed interval f{a, b] 
may coincide with the entire interval [—a, =<], i.e. from the uniform 
convergence of the Fourier series of f (x) throughout [—a, x] it follows 
that wt is to f (x) that that series converges on that interval. 


Remark 2. Quite similar corotlanes will be true for a Fourier series with 
respect to any other closed orthonormal system in the space of functions piece- 
wise continuous on an arbitrary interval {«, b] with scalar product (40.2) and 
norm {{0.8). The orthonormal systems associated with Legendre and Chebyshev 
polynomials and the Haare system (see Section 10.1) may serve as examples of 
such systems. 


10.4. THE SIMPLEST CONDITIONS FOR THE UNIFORM CONVERGENCE 
AND TERM-BY-TERM DIFFERENTIATION OF A FOURIER 
TRIGONOMETRIC SERIES 


10.4.4. Introductory remarks. Of great importance in mathemati- 
cal physics and in a number of other branches of mathematics is the 
question of under what conditions the Fourier trigonometric series 
of a function f (x) converges (to that function) at a given point 7 
of a closed interval [—a, x). 

Tt was known as far back as the late NIN century that there are 
functions, continuous on [—a, xa] and satisfying the condition 
fj (—a) = f (x), whose Pourier trigonometric series diverge at a prea-- 
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signed point of [—x, 2] (or diverge even on an infinite set of points 
of [—x, x] everywhere dense on that interval)*. 

Thus the continuity alone of f (x) on [—nx, x] without any addi- 
tional conditions fails to ensure not only the uniform convergence 
of the Fourier trigonometric series of that function but even the 
convergence of the series at a preassigned point of [—zx, x]. 

In this and the next section we shal] explore what requirements 
should be added to the continuity of f (x) (or introduced instead of 
the continuity of f (x)) to ensure the convergence of the Fourier trig- 
onometric series of f (x) at a given point as well as its uniform con- 
vergence throughout [—n, x] or some part of it. 

Yet another question arises in the study of the convergence of 
a Fourier trigonometric series: must the Fourier trigonometric series 
of any function 'f (x) piecewise continuous (or even strictly conti- 
nuous) on [—zx, m] converge at least at one point of the interval? 

A positive answer to that question was obtained only in 1966. 

It is a consequence of the fundamental theorem, proved in 1966 
by L. Carleson**, that has solved N. N. Luzin’s*** famous problem 
formulated as early as 1914: The Fourier trigonometric series of any 

a 


function f (x) for which there is an integral { f? (x) dz understood in the 


—T 

mre sense converges to that function almost everywhere on [—x, 
E14 haba 

From Carleson’s theorem it follows that the Fourier series of any 
function f (x) integrable on [—x, x] in the proper Riemann sense, 
as well as that of any piecewise continuous function f (x), converges 
almost everywhere on [—zx, x] to f (x) (since there is an integral 
x 


\ f* (z) dz in the Riemann sense and therefore in the Lebesgue sense 


~T 
for such a function). 

Note that if a function f (x) is integrable on a closed interval 
{[—x, x] not in the Riemann sense but only in the Lebesgue sense, 
then the Fourier trigonometric series of that function may fail to 





* The earliest example of such a function was constructed by the French 
mathematician P. du Bois-Reymond in 1876. 

** Lennart Carleson is a modern Swedish mathematician. A full proof of 
Carleson's theorem can be found in Selected problems on exceptional sets by Lennart 
Carleson (Russian translation in Matematika, Vol. II, No. 4, 1967, pp. 113-132). 

*** Nikolay Nikolayevich Luzin (1883-1950) isa Soviet mathematician, the 
founder of the modern Moscow school of function theory. The statement of 
Luzin’s problem solved by Carleson and of his other problems can be found in 
N.N. Luzin. The Integral and Trigonometric Series, Moscow, Leningrad, Gos- 
tekhizdat (1951). 

+*** For the definition of the integral in the Lebesgue sense and of the con- 
vergence almost everywhere on a given closed interval see Chapter 8. 
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converge at any point of {[—zx, a]. The Soviet mathematician 
A. N. Kolmogorov* was the first to construct in 1923 an example of 
a function f (z) integrable on [—a, a] in the Lebesgue sense, with 
an everywhere divergent Fourier trigonometric series. 

10.4.2. The simplest conditions for absolute and uniform convergence 
of a Fourier trigonometric series. Let us agree to use the following 
terminology: 

Definition 1. We shall say that a function f (z) has a piecewise con- 
tinuous derivative on a closed interval [a, b] if the derivative f' (x) 
exists and is continuous everywhere on [a, b] except possibly for a finite 
number of points at each of which the function f' (x) has finite right- 
and left-hand limiting values**, 

Definition 2. We shall say that a function f (x) has a piecewise con- 
tinuous derivative of order n > 1 on a closed interval (a, b) if the func- 
tion f{™-) (x) has on that interval a piecewise continuous derivative 
in the sense of Definition 1. 

The following main theorem is true. 

Theorem 10.11. If a function f(z) is continuous on a closed interval 
{[—zx, x], has on it a piecewise continuous derivative and satisfies the 
condition f(—x) =f (x), then the Fourier trigonometric series of 
f (x) converges to that function uniformly on [—x, x]. Moreover, the 
series made up of the absolute values of the terms of the Fourier; trigono- 
metric series of { (x) converges uniformly on [—x, x]. 

Proof. 11 suffices to prove that the series made up of the absolute 
values of the terms of the Fourier trigonometric series} of f (x) 


Ire + >) {]a, cos kx] + |b, sin kz} (10.41) 


h=l 


converges uniformly on [—x, st], for this will imply both the uni- 
form convergence on [—zx, x] of the Fourier trigonometric series it- 
self of f (x) and that it is to the function / (z) that that series con- 
verges (by Corollary 5 of Section 10.3.3). 

By virtue of the Weierstrass test (see Theorem 41.4), to prove uni- 
form convergence on [—ax, x] of the series (10.41) it suffices to estab- 
lish the convergence of the number series 


3 (lanl + [bal (10.42) 


* A construction of A.N. Kolmogorov's example can be found on pages 412 

to 424 of the book: N.N. Bari, Trigonometric Serics, Moscow, Fizmatgiz (1964). 

** The function /’ (z) may turn out to be undefined at a finite number of 

points of [a, 8}. We specify it arbitrarily at those points (for instance, we set it 
equal to the half-sum of the right- and left-hand limiting values). 
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majorizing it. Denote by a, and f;, the Fourier trigonometric coef- 
ficients of the function f’ (x) specifying the function arbitrarily in 
a finite number of points at which there is not derivative of f (x)*. 
Integrating by parts and considering that f (x) is continuous through- 
out [—a, x] and satisfies the relation f (—x) = f (x) we obtain 
the following relations connecting the Fourier trigonometric coef- 
ficients of the function f’ (x) and those of the function f (x) itself:** 


7 a 
a, = + j i (x) cos hin de = ke { f(x)sinkzrdz=k-b,, 
-71 at 
7 x 
By = os Wet \sinkzdz= Oe en fiw coskzdr= —k.a 
L= > x) si = x) = hp: 
~-% ms 
Thus 
Jan} + Jbn] = AGEL 3. et 








k k 


and, to prove the convergence of the series (10.42), it suffices to estab- 
lish the convergence of the series 


Ser LBs, (10.43) 


The convergence of the series (10.43) follows from the elementary 
inequalitiest** 


Go <z (ok + ar): 








4 i 
Pol <5 (BR-+ fr) (10.44) 
and from the convergence of the series 
o ao 4 
>) (h-- PR), Dae (10.45) 
het he==t 


* For instance, we may set the function jf’ (x) at those points equal to a half- 
sum of the right- and left-hand limiting values. 

** When integrating by parts one should divide [—zx, x] into a finite number 
of subintervals having no interior points in common on each of which the 
derivative f' (x) is continuous and, taking an integration by parts formula for 
each of the subintervals, consider that when summing the integrals over all 
subintervals all the substitutions vanish (because of the continuity of j (z) 
‘throughout [—x, x] and the conditions f (~—n) = f (x)). 


*** Wo proceed from the clementary inequality | a@{-| | <F (a?+-0%) 
following from the nonnegativity of (| a|—J}b})*. 
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the first of them converging by virtue of Parseval’s formula for a 
piecewise continuous function j’ (x) and the second by virtue of the 
Cauchy-Maclaurin integral test (see Section 13.2 of {4]). Thus the 
theorem is proved. 

Remark. If a function f (x) satisfying the hypotheses of Theo- 
rem 10.11 is periodically (with period 27) extended to the whole 
infinite straight line, then Theorem 10.11 will state convergence of 
a Fourier trigonometric series to the function thus extended that is 
uniform throughout the infinite straight line. 

10.4.3. The simplest conditions for term-hy-term differentiation 
of a Fourier trigonometric serics. We shall first prove tho following 
lemma on the order of Fourier trigonometric coefficients. 

Lemma 1, Let a function f (x) and all of its derivatives up to some 
order m (m boing a nonnegative integer) be continuous on a closed 
interval |—a, x] and satisfy the conditions 


H(—n)=f(a), 
te esG (10.46) 


ee ee eo 


Also let f (x) have on [—n, x] a piecewise continuous derivative of 
order (mn -+ 4). Then the following series converges: 


Pr I {lay | + 1d, 1}, (10.47) 


where a, and b, are the Fourier trigonometric coefficients of f (x). 

Proof. Denote by @, and B; the Fourier trigonometric coefficients 
of the function /("*) (x), specifying the function arbitrarily in a 
finite number of points at which tho function f (x) has no derivative 
of order (m -j- 1). Integrating the expressions for «, and fi, (m -+ 4) 
times by parts and considering the continuity throughout [—a, a] 
of the function f (x) itself and of all its derivatives up to order m 
and taking into account relations (10.46) we establish the following 
relation of the Fourier trigonometric coefficionts of the function 
fm) (x) to the function f (zx) itself*: 


lent -F [Ba] = A! {fay | ie [On 1}- 


Thus 
A” {lay | Ae [dy |) = Au HBr 


* When integrating by parts one should divide the closed interval [—a, a] 
into a finite number of subintervals having no interior points in common on cach 
of which /0"*4) (z) is continuous and consider that summing the integrals over 
all the subintervals makes all substitutions vanish. 
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and the convergence of the series (10.47) follows from the elementary 
inequalities (10.44) and from the convergence of the series (10.45), 
the first of them converging by virtue of Parseval’s formula for a 
piecewise continuous function f+) (x) and the second by virtue 
of the Cauchy-Maclaurin test. Thus the lemma is proved. 

An immediate consequence of Lemma 1 is the following theorem. 

Theorem 10.12. Let a function f (x) satisfy the same conditions as 
in Lemma 1, with m1. Then the Fourier trigonometric series of 
f (z) can be differentiated term by term m times on |—n, x). 

Proof. Let s be any of the numbers 1, 2, ..., m. Asa result of an 
sfold term-by-term differentiation of the Fourier trigonometric 
series of f (x) we obtain the series 


> ks {a cos (kz —}) +-b, sin ( hex —=)} 4 (10.48) 
h=t 


Note that for every x in [—z, x] both the original Fourier me 
onometric serics and the series (40.48) (with any s = 4, 

can be majorized by the convergent number series (10. 47). “By the 
Weierstrass test (see Theorem 4. 4) both the original Fourier trigono- 
metric series and each of the series (10.48) (with s = 1, 2, ..., m) 
converge uniformly on [—zx, a] and this (by virtue of Theorem 1.9) 
ensures the possibility of an m-fold term-by-term differentiation of 
the original Fourier series. Thus the theorem is proved. 


10.5. MORE PRECISE CONDITIONS FOR UNIFORM 
CONVERGENCE AND CONDITIONS FOR CONVERGENCE 
AT A GIVEN POINT 


10.5.4. The modulus of continuity of a function. Holder classes. 
Weshall begin with explaining the concepts characterizing the smooth- 
ness of the functions under study and with defining the classes of 
functions in terms of which we shall formulate the conditions for 
convergence of a Fourier trigonometric series. 

aes a function f (z) be defined and continuous on a closed inter- 
val [a, b 

Definition 1. For every § > 0 the modulus of continuily of f (z) 
on{a, b) is the supremum of the absolute value of the difference | f (x') — 
— f(z’) i on the set of all x’ and x” of (a, bj satisfying the condition 
ja’ ~ 2" | <6. 

We shall denote the modulus of continuity of f (x) on [a, b] by 
o (5, f). So by definition*® 

o(6 f= sup Ife") (el. 


x’ ~ 


sae is gs 


* Recall ne the symbol € stands for ‘ ‘belongs to, is in”, so that the notation 
z', x” € {a, b] designates that the points 2’ and x” are ina closed interval (a, 6}. 
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It is immediate from the Cantor theorem (see Theorem 10.2 in 
{4]) that the modulus of continuity w (8, f) of any function f (x) con- 
tinuous on la, b) tends to zero as & + 0*. 

However for an arbitrary function f (z) only continuous on fa, 0} 
nothing in general can be said about the order of its modulus of con- 
tinuity @ (0, f) with respect to a small 6. 

We now show that if a function f (x) is differentiable on la, b] and 
if its derivative {’ (x) ts bounded on (a, b}, then the modulus of conti- 
nuity of f (z) on that interval, (8, {), has an order w (5, f) = O (5)**. 

Indeed, it follows from the Lagrange*** theorem that for any points 
z’ and zx” in la, b] there is a point & contained between z’ and 2° 
such that 


lf@) -f@)1= 1/7 @ll2 —2" I (10.49) 


Since the derivative f’ (xz) is bounded on [a, b] thero is a constant A 
such that for every x in the interval |’ (z) |< df and therefore 
17’ (€) |< Af. From the last inequality and from (10.49) we con- 
clude that | f(z’) — f(t") |< 4/6 for every zx’ and 2” in fa, b] 
satisfying |2’ —2z”|< 6. But this means that w (5, f) < Af, 
i.c. w (5, f) = O (8). 

Let «@ be any real number in the half-open interval O<a <1. 

Definition 2. We shall say that a function { (x) belongs on a closed 
interval (a, b] toa Hilder class C% with index a (0 <a <1) if the 
modulus of continuity of f (z) on fa, b] has an order w (6, f) = O (5%). 

To designate that f (x) belongs to a Hélder class C% on [a, b} one 
usually uses the notation: f (x) € C* [a, b). 

Note at once that if a function f(z) is differentiable on la, 0} 
and its derivative is bounded on that interval, then f (z) a fortiori 
belongs on [a, b) to the Hélder class C!**** (this statement follows 
immediately from the relation w (5, f) = O (5) proved above). 

Remark. Let f(z) €C%[a, b}. The supremum of the fraction 


Lite on the set of all z’ and x” of {a, b] not equal 
et 4 

to each other is called the Hélder constant (or the Hoélder coef- 
ficient) of f(z) (on [a, 6)). The sum of the Hélder constant of 
f(x) on [a, 6] and the supremum |f(z)| on that interval is 
called the HWélder norm of |f(zx)| on fa, 6b) and designated 


if WNcape, by 


i 
* For (by the Cantor theorem) given any e >0 we can find 6 > 0 such that 
f(z) —£ 2) 1 <e for every z’ and z” in [a, b] satisfying the condition 
ri x" | co, 
** Recall that the symbol @ = 0 (4) was introduced in Chapters 3 and 4 
of [4] and denotes the existence of a constant Jf such that | @ { <= Af6. 
w%% Seo Theorem 8.12 in [1] . 
«a* The Holder class C* corresponding to the value « = 1 is often called the 
Lipschite class. 
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Example. The function f(z)=\Vz belongs on a closed inter- 
val (0, 1} to the class C'?, for | f(x')—f(«")|=V2'—2" x 
x Fee SV z’—x” for any x’ and x” in (0, 1] related by 

z 
the condition x’ > x” (the Hélder constant that is the supremum 


on {0, 1] of the fraction 


Hilder norm to two). 

10.5.2. An expression for the partial sum of a Fourier trigonometric 
series. Let f (z) be an arbitrary function piecewise continuous on 
aclosed interval [—x, 2]. We shall extend that function periodically 
(with period 2x) to the whole infinite straight line*. Denote by 
5S, (z, f) a partial sum of the Fourier trigonometric series of f (x) 
at a point z equal to 





Via being equal to unity and the 


Sr(z, fl= B+ > (a, cos kx +-b, sin kz). (10.50) 
k=1i 
Inserting into the right-hand side of (10.50) the values of the Fourier 


coefficients** 
a 


= S rudy, 


1 


l 


a 


a od 
a=t [ fly)ooskydy, bk= | fly)sinky dy (k=4,2,...) 


—7 Tt 
and taking into account the linear properties of the integral we get 


Sy (x, f) = j f(y) [++ D} (cos ky cos kx -++ sin Ay sin ke) | dy = 
1 h=1 


=i j ty) (tay cos ke (y—z) | dy 
—x h=t 


* By the convention adopted as far back as in Section 10.1 a piecewise con- 
tinuous function f (x) must have at every point z a value equal to a half-sum of 
the right- and left-hand limiting values. For this property to take place and for 
{@ to be periodically (with period 2x) extended to the whole infinite straight 
ine we must require that the relation f (x) =f (—x) = (4/2) [f (—a + 0) + 
++ f (x — 0)] should hold for the extended function. In other words, we shall 
say that a function f (z) defined on an infinite straight line is a periodic ertensi-m 
of a function f (x) piecewise continuous on a closed interval {—xa, x] if both 
functions coincide on the interval —nx < z <x and if the function f (z) de=ne3 
on the infinite straight line satisfies the periodicity condition f (rx — 2n} => (>> 
and the condition f (x) = f (—x) = (1/2) {f (—a + 0) + f (a ~ 0)]. 

** See formulas (10.23). : 

FO eo 


2101684 omy 
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for any point z of an infinite straight line. On making in the last inte- 
gral a change of variable y = ¢ + z we arrive at the following ex- 
pression 


Sila N=— J sety[$+ > cosae] ar. (10.51) 
=x hunj 


Note now that since either of the functions f(x-+i) and 
n 


[+> cos it | is a periodic function of the variable ¢ with 
A= 

period 27, the entire integrand in (10.51) (denote it briefly by 
F (t)) is a periodic function of ¢ with period 22. Also note that 
integration in (10.51) is over [—a—z, n—zz] of length equal 
to 2x, i.c. equal to the period of the integrand. We use the 
following elementary statement: if F(t) is a periodic function of 
period 2x integrable over any finite closed interval, then all 
integrals of that function over any of the closed intervals of 
length equal to the period 2x are equal to one another, i.e. for 
any x 


tex 


[ raya= | Fware. (10.52) 


~ Te 


Equation (10.52) allows us to rewrite formula (10.54) as follows: 
Sy(a, j=t { {(xz-+1) (4+ x cos kt | dt. (10.53) 
~1 k=] 


Compute the sum in the square brackets in (10.53). To do this note 
that for any k and any value of t 


gt : 1 F 4 
~_— i= et —_— — es 
2sin 5 cos kt sin (Kk na ) t—sin (x 5 ) t. 


* To prove this statement it suffices, using the additive property, to repe 
aw 
resent ( F (t) dt as the sum of three integrals 
-a-x 
-1% Pad THX 
( F(t)dt+ ( F(t) dt+ [ F(t)dt 
“nex =n x 
and to note that with the aid of the periodicity condition F (t) = F (t+ 22) 


and the change of variable t = y — 22 the first of the three integrals js reduced 
to the third taken with the minus sign. Indeed, 


~at “71 


eed 
[ F (t)dt= \ Ft-2ayat= | F (yy dt=— j F (u) dy. 


tex 7 


TH x 


—-N-=z THX 


Ch. 10. Fourter Series and Fourier Integral 323 


Summing this equation over all & equal to 1, 2, ..., m we get, 


rR 

{ _ et ~) eet 
» - cos kt =sin (n + > t—sin->. 
het 


asin | > +3 coskt |=sin (n+ e 


and therefore 


[+ +3 or ene te 2 (10.54) 


2sin— 


Substituting (10.54) in (10.53) we finally obtain the following ex- 
pression for a partial sum of a Fourier trigonometric series: 


a sin [n+—]t 
Sn (et, f= fe eal dt (10.55) 
v ~7T 2 sin ~- 


true at any point z of an infinite straight line. 
Remark. From formula (10.55) and from the fact that all partial 
sums S,, (x, 4) of the function f (x) = 1 are equal to unity* we get 


1 sin (nts) + ” 


~1 2sin — 
10.5.3. The integral modulus of continuity of a function. Let a func- 
tion f (x) be integrable (in the sense of an improper Riemann integral) 
on a closed interval [—x, x]. We extend that function periodically 
(with period 2x) to the whole infinite straight line. 
Definition. For any § of the half-open interval O0<(5 < 2x the 
integral modulus of continuily of a function f (x) on a closed interval. 
—x, m] is the supremum of the integral 


(40.56) 


pa". 
m4 


ead 
J fe+u—F@lae 
1 
on ihe set of all numbers u satisfying the condition |u|<6 


We shall denote the integral modulus of continuity of . function 
f (z) on a closed interval [—n, x) by I (6, 7). 


* For the quantity (10.55) for the fone ‘ee == 1 is equal ‘ 
(10.50), where ag = 2, a, = b, = 0, k= ! 


AT yore 
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So by definition 
it 

1(6. f)= sup, \ if tu)— f(g ae. 
a 1 


The following statement is true. 

Lemma 2. Ifa function f (x) is piecewise continuous on a closed in- 
terval |—a, x) and periodically (with period 2x) extended to the whole 
infinite straight line, then the integral modulus of continuity of the 
function on that interval, I (6, f), tends to zero as 6 (0. 

Proof. Fix an arbitrary e > 0. According to Theorem 10.10 (on 
the closure of the trigonometric system) for a function f (x) there is 
a trigonometric polynomial 7 (x) such that 


{x 
w—ri=V furw-rora <8 VR, 


and therefore on the basis of the Cauchy-Buniakowski inequality* 


fvo—rola<V fum-rora faces. (10.57) 


From inequality (10.57) and from the fact that f(t) and 7 (t) are 
periodic functions of period 2x we conclude that for any number u 


Tt 


( i +u)—T(t-+u)| dti<el3. (10.58) 


7 


Since the absolute value of the sum of three quantities is al most the 
sum of the absolute values of those quantities, for any number u 


| vetm—reolds | ermy—Petwlac+ 
fy \ [7 (tu) —T (t)] dt+ \ [7 (t)—f (d)] dt. (10.59) 


-% ee 


Now it remains to note that by virtue of the continuity clatrigono- 
metric polynomial and the Cantor theorem (see Theorem 10.2 in 
[4]) for the fixed ¢ > O there is 6 > 0 such that for |u| <6 and 
every ¢ in [—z, a} 

IT @+u)—T () |< cl6a, 


* See inequality (4.33). 
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and therefore 


IT (t--u)—T (t){ dt<e/3. (10.60) 


ices rs) 


Comparing (10.59) with inequalities (10.57), (10.58), and (10.60) 
we get 


lf (ttu)—f(t)|dt<e (10.61) 


tea 


for every u for which |u |< 5. Thus the lemma is proved. 


Remark to Lemma 2. It is easy to see that the integral modulus of continuity 
T (8, f) tends ta sera as § + Q not only for any piecewrise continuous function f (z) 
but also for any f (x) integrable (in the proper Riemann sense) on a closed interval 
{—a. af. To prove this fix an arbitrary © > 6 and note that by virtue of the 
integrability of f (f) on —a <t < x there is $y > O such that for eny subdivision 
of {—2, 2] into subintervals of length smaller than 5, the difference between the 
upper and lower sums of f 0 is less than e/4. Fix some subdivision 7 of [—a.2] 
into subintervals of equal length 5 < 6). From the fact that f (?) is a periodic 
function it follows that for any | uv | < 6 and for the fixed subdivision 7 of 
—t<t<sa the difference between the upper and lower sums of the function 
f(t-++ uv) (vith 8 sufficiently small) is at least less than e/2. But from this it 
follows that for the fixed subdivision 7 the difference between the upper and 
lower sums of the function {7 (¢ + vu) — f. (01, with any {uw | <4, is less than 
a4 + 2/2 = 3/, ©. Denote for the fixed subdivision 7 the upper and lower sums 
of [f (t+ u) — J (t)] respectively by S and s and the upper and lower sums of 
the function | 7 (¢ + x) — 7 (f) | respectively by S and s. It has been established 
in Section 10.5 of [{] that for any subdivision the upper and lower sums § and s 
of the function itself and the upper and lower sums S and s of the absolute value 


~ 


of that function are_connected by the relation S—s< S—s. Thus, for the 
fixed subdivision T, S — s < 3e/4. But this means that for the fixed subdivision 


T the difference between any integral sum of the function | f (¢+ u) —/f ()] 
Pye 


and the integral \ lf @+u)~—F (1 at is less than the number 3e/4. 


Tt 
If we choose in that integral sum all the intermediate points = in the 
centre of the corresponding subintervals of Iength § and require that the 
number u should satisfy the inequality | uj <6'2, then both points &, 
and & + 4u will be in the sth subinterval and therefore the difference 
7 (& + u) — 7 (Ex) | will not exceed the oscillation 1, — mz, of f(t) on 
the th subinterval*. But then the entire integral sum is not greater than the 
sum “* (14, — mz) AG, equal to the difference between the upper and lower 


sums of f (2) of a subdivision 7. i.e. is not greater than the numher e/4. It follows 





* By 3f, and m, we denote the supremum and infimum of 7 (f) on the Ath 
subinterval. 
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ps 


‘that for fu | < 6’2 the integral [ 17 (t-- u) —f (2) ] dt is not greater than 


—st 
the number e, which proves that J (8, f) tends to zero as 6 = 0. 


We now derive from Lemma 2 a number of corollaries impor- 
tant for what follows. 

Corollary 1. If a function f (t) is piecewise continuous on a closed 
interval [—a, x] and periodically (with period 2x) extended to the 
whole infinite straight line and x is any fixed point of {—ax, x], then 
for any & > 0 there is 5 > 0 such that 

a 

(if (c+t+uy—fetdldi<e, (10.62) 

—% 
with Ju | <6. 

Proof. On making in the integral on the left of (10.62) a change of 
variable r= a2+t 


a Atx 


[i(ztttw—f(etnlar= | tw —s (afar 
“nx =T+4x 
and observing that (by virtue of equation (10.52)) 
THX 1 
[ @tuy—fiidr= | f(e+m—s (lar, 
-A+x ae 


we see that inequality (10.62) is a consequence of (10.64). 
Corollary 2. If each of the functions f (t) and g (t) is piecewise con- 
tinuous on |—x, a] and periodically (with period 2x ) extended to the 
whole infinite straight line, then the function 
iv 
I()= [f@tng(ar 
=n 
és a continuous function of x on a closed interval —-n ar<n. 
Proof. Let x be any point of [—a, a]. Then 
at 
[(r+u)—T(z)= ( (f(r+t+u)—f(z+ip g(t) dt. 


co § 


and since the function g (f) piecewise continuous on |[~x, a] sut- 
isfies on that interval the boundedness condition | g (f) |< J/, we 
have 


JT (etu—T(2) <M (flee teuy—f(x+n) lat 
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and therefore in view of (10.62) for any « >0 
[\il(@+wu—T(z[<e, if{ul< 6 (e). 


Thus the continuity of J (x) at a point x is proved. 

Corollary 3. If each of the functions f (t) and g (t) is piecewise con- 
tinuous on |—n, 2m] and periodically (with period 2x) extended to the 
whole infinite straight line, then the Fourier trigonometric coefficients of 
the function F (x, t) = f (c + t) g (t), when this function is expanded 
in terms of t, 


Qn (y= t j f (z+) g(t) cos nt dt, (10.63) 
bn(a)=— | f (et) g(t) sin nt di (10.64) 


converge to zero (as n —> co) uniformly with respect to x on [—x, a] 
(and therefore on the whole infinite straight line). 

Proof. For any fixed point z of [—a, a] the function F (z, t) = 
= f (x + 2) g (t) is a piecewise continuous function of the indepen- 
dent variable t on |—zx, x] and therefore Parseval's formula 





ae + DY (ah (2) + bf (=— {r (x-+1) g(t) dt (40.65) 
ket ~1 


holds for this function*. Equation (10.65) implies the convergence 
of the series on its left at each fixed point « of [—x, am]. Since that 
series consists of nonnegative terms, to prove its uniform convergence 
on [—x, x] it suffices by the Dini theorem** to establish that both 
each of the functions a, (x) and b, (z) and the sum of the series (10.65) 


a 


4 \ f(x + t) g(t) dt are continuous functions of z on [—n, a], 


Dora’ 
but this follows at once from the preceding corollary (it suffices to 
consider that the square of a piecewise continuous function is a piece- 
wise continuous function and that cos nt and sin nt, with every n 
fixed, are continuous functions). 

Corollary 4. If each of the functions f (1) and g (t) is piecewise con- 
tinuous on |—x, m] and periodically (with period 2x) extended to the 


* See Corollary 4 in Section 10.3.3. 
** See Theorem 1.5 (statement in terms of series). 


328 IFrndamentals of Slathematical Analysis 


whole infinile straight line, then the sequence 


cy (2) = | fete @sin (n4+5) tat (10.66) 


“ 


converges to zero uniformly with respect to x on {—x, 2] (and therefore 
on the whole infinite straight line). 
Proof. It suffices to consider that 


. 1 ase , t 
sin (n+5)1=cosnt-sin-+ -+-sin nl COS <> 


and apply Corollary 3, taking the function g (/)-sin 5 instead of 


g(t) in (10.63) and the function g (t):cos — instead of g(t) in 


2 
(10.64). 

10.5.4. The principle of localization. We shall prove here that 
the question of whether the Fourier trigonometric series of a func- 
tion f (z) piecewise continuous on [—x, a] and periodical (with 
period 2x) converges or diverges al a given point z) can be solved 
only on the basis of the behaviour of the function f (x) in arbitrarily 
small neighbourhood of x9. This remarkable property of a Fourier 
trigonometric series is generally called the principle of localization. 

We begin by proving an important Jemma. 

Lemma 3 (Riemann). If a function f{ (x) is piecewise continuous 
on [—xn, a] and periodically (with period 22) extended to the 


whole infinite straight line and if it vanishes on some interval 


as b— 
{a, b}*, then for any positive number 6 smaller than 5 “the 





Fourier trigonometric series of f(x) converges to zero uniformly 
on the interval {[a-+-6, b—6]. 
Proof. Let 5 be an arbitrary positive number smaller than 
b—a 
ae 
j(c) at an arbitrary point z of an infinite straight line is defined 
by equation (10.55). Setting 


The partial sum of the Fourier trigonometric series of 





when 6<|t|<a, 


(10.67) 


ts] ~ 


g(i= 2sin 
0 when [i{[<4 

and considering that f (z + 1) is zero provided x is in [a + 6, b — 4] 

and ¢ is in the interval | ¢ | << 6** we may rewrite (10.55) for each 


* The closed interval [a, &) is quite arbitrary. In particular, it may be con- 
tained entirely in [—a, =}. 
** By virtue of the fact that f (z) is zero throughout fa, d]. 
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z of [a + 6, b — 6] as 


1 


Sy(a =e | fe+te(e)sin(n+5) tae. 


—t 


It remains to take into consideration that by Corollary 4 of Section 
10.3.3 the sequence on the right of the last equation converges io 
zero uniformly with respect to x on the whole infinite straight line. 
Thus the lemma is proved. 

Immediate consequences of Lemma 3 are the following two 
theorems. 

Theorem 10.13. Let a function f (x) be piecewise continuous 
on a closed interval {—x, 1] and periodically (with period 22) 
extended to the whole infinite straight line and let {a, b] be some 
closed interval. For the Fourier trigonometric series of f(x) to 
converge, with any positive § smaller than 258 , (to f(x)) uni- 
jormly on the interval fa+-6, b—§) it is sufficient that there is 
a periodic (with period 2x) function g(x) piecewise continuous on 
[—a, x) that has a Fourier trigonometric series uniformly con- 
verging on {a, b] and coincides on {a, b] with the function f(z). 

Proof. Applying Lemma 3 to the difference [f(x)—g(x)] we 
see that the Fourier trigonometric series of the difference [f (z)— 
g(x)] converges to zero uniformly on [a-+6, 0—6] for any 6 in 
the interval 0<5< v8 , and from this and from the uniform 
convergence on [a, b] of the Fourier trigonometric series of g (z) 
we obtain the uniform convergence on [a+ 6, b—6] of the Fou- 
rier trigonometric series of f(z). The fact that it is to f(x) that 
the last series converges on [2+65, b—8] follows immediately 
from Corollary 5 of Section 10.3.3. Thus the theorem is proved. 

Theorem 10.14. Let a function f (x) be piecewise coniinuous 
on a closed interval [—mx, x] and periodically (with period 2x) 
extended to the whole infinite straight line and let xg be some point 
of the line. For the Fourier trigonometric series of f (x) to converge at 
Zp it is sufficient that there is a periodic (with period 2n) function 
g (x) piecewise continuous on {—x, x) that has a Fourier trigonometric 
series converging at the point 2» and coincides with f (x) in an 
arbitrarily small 5-neighbourhood of xp. 

Proof. Jt suffices to apply Lemma 3 to the difference (f (x)— 
—g(zx)J on the interval [»—$, m+ > | and consider that the 
convergence at 2 of the trigonometric series of the functions 
[f (z)—g (z)] and g(z) implies the convergence at that point of 
the Fourier trigonometric series of f(z) as well. Thus the theo- 
rem is proved. 








o, 
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Theorem 10.14 does not establish any particular sort of conditions 
that ensure the convergence of the Fourier trigonometric series of 
f(z) at a point zp. It only proves that those conditions are deter- 
mined solely by the behaviour of f(z) in an arbitrarily small 
neighbourhood of 2x, (i.e. have a local character). 

10.5.5. Uniform convergence of a Fourier trigonometric Series 
for functions of a Hélder class. In this and the next subsection we 
shall discuss more precise conditions ensuring the uniform conver- 
gence and convergence of a Fourier trigonometric series at a given'point. 

We prove the following main theorem. 

Theorem 10.15. If a function f(z) belongs on [—a, =a] to a Mélder 
class C® with an arbitrary positive index a (O< a <1) and if in ad- 
dition f (—x) = f (a), then the Fourier trigonometric series of f (x) 
converges (to that function) uniformly on [~zx, a]. 

Proof. We shall assume as usual that f (x) is extended periodically 
(with period 27) to the whole infinite straight line. The condition 
f(—x) =f (a) ensures that the function thus extended belongs 
‘to a Holder class C% on the whole infinite straight line. 

Let x be any point of [—a, a]. Multiplying both sides of (10.56) 
by f (z) and subtracting the resulting equation from (10.55) we get 


{ 7 sin (x 5) { 
Siz. N—f(a=t | e+ —4 (2) ——2— at. (10.68) 


-n 2sin-> 


‘The condition that f (r) belongs to a Hilder class C* implies that 
there is JZ such that 
{\f(e@+t)—f(z) |< M-te (10.69) 
in any case for every z and every ft in [—a, al. 
Fix an arbitrary e > 0 and choose for it 6 > O satisfying 


ive € « 
= & 3: (10.70) 


Dividing [—z, =] into a sum of the closed interval |f |< 6 and 
the set 6< [¢ |< 2a, we make equation (10.68) take the form 


sin (x+4): 


1 - 
Si(z A—f@=+ | ifleto—sf(n 2 i dt+ 
[fix 2sin = 
4 
< sin na Jt 
+e | fe+y ( z) dt— 
6<iticn 2sin > 
1 
fo { eau (10.74) 
*  pcitics Sein 


Ch. 10. Fourier Serres and Fourier Integral 331 


To evaluate the first of the integrals on the right of (10.71) use 


inequality (10.69) and consider that + <54- for every 
2 sin | 7 
2 





tin [—a, a]*. 
We see that for any 2 and any zr in [—a, x] 


(n-4) 





{et Fei 2 ane 
1t\<6 sins 
: 4 
sinfn—-~)t 
< | if@+y—f(a} | r) ie 
{ tj<o 2 sin 5| 
3 
<a ( [rt tdt= Ma | to'dt= crs -6*. 
1tl<6 t 


From this in view of (10.70), for any 7 and any z in [—2z, =] 


= § tf@+)-fm- 


tth<6 2sin— 


dty< 


| a 


(10.72) 


Using the function (10.67) piecewise continuous on the second of 
the integrals on the right of (10.71) can be written as 


=+ [rete sin(n+5)t. 


-1 


By Corollary 4 of Section 10.5.3 the right-hand side of the last equa- 
tion converges to zero (as m —~ oo) uniformly with respect to z on 


* This inequality follows immediately from the fact that the function 
ae decreases from 1 to 2/m as x changes from 0 to 2/2. The fact that 


Sinz sinz\’  coss 
3 decreases follows in turn from the fact that {———] = 





2° 


xX (r—tan z) < 0 everywhore for 0< 2 << 2/2, since r<tanz for 0<c2< 11/2 
(see Section 4.5.6 of ji }). 
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{—nx, x]. For the fixed « > 0 therefore there is V, such that 


\ r sin (x +e) ‘ 
= \ i (z-+1)-—————dl< 5 (10.73) 
S<t (<a 2sin > 


for every n > N, and every x in [—a, a). 

To evaluate the last integral on the right of (10.71) notice that 
using the piecewise continuous function (10.67) this integral can he 
written as 


1 
— aut (n+5 t : x 
Lis) [ - dt = 12 | & (i) sin (n+) tal. 
, % 2si mm , 5 
6<fti<a 2sin = oe 


The integral on the right of the last equation converges to zero (ns 
n ~» oo) also by Corollary 4 of Section 10.5.3 (it suffices to apply 
that corollary to the function f(z) = 1). Considering also that 
f (z) is in any case bounded on [—a, x] we see that for the fixed arbi- 
trary ¢€ > 0 there is NV. such that 


1 
% sin nbs t ; 
Ho | lage, dijt (10.74) 
n a 9 t 3 
d<lii<a —-2sin-z 


for every n> NV. and every 2 in [—a, a). 

On denoting by .V the largest of the two integers V’, and NV, we 
find by virtue of (10.71) to (10.74) that for the fixed arbitrary e > 0 
there is NV such that 


[Sn (zs f)-—f@)i<e 


for every n > N and for every x in [—a, a]. Thus the theorem is 
proved. 

Remark 1. It is obvious that under the hypotheses of Theorem 10.15 
the Fourier trigonometric series converges uniformly not only on 
[—n, x}, but also uniformly on the whole infinite straight line (to \he 
function which is a periodic (with period 2n) extension of f (z) to the 
whole infinite straight line). 

Remark 2. Note that in evaluating the integrals (10.73) and (10.74) 
we used only the piecewise continuity (and the resulting bounded- 
ness) of the function f (r) on [—a, a] (no use was made of the fact 
that f(r) belongs to a Holder class). 


Remark 3. The question naturally arises as to whether it is possible to slack- 
en in Theorem 10.15 the smoothness requirement on f (7) while preserving the 
statement about the uniform convergence on {[—~2, 2] of the Fourier trigonometric 
series of f (z). 
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Recall that the fact that f (x) belongs on [—2, a] to a Hélder class C® means 
by definition that the modulus of continuity of f (z) on [—x, <t] has an order 


o (6 f) = 0 (8%). 


We note without proof the so-called Drai-Lipschitz theorem which states that for 
the Feurier trigonometric series of jf (x) to converge unitormly on [—a, x] it is 
sufficient that f (x) satisfies f (—a) = f (4%) and that its modulus of continuity on 
{—x, a] has an order 


4 
06, N=0(aae), 
ie. is an infinitesimal, as 5 — ©. of an order higher than “his * 


The Dini-Lipschitz theorem contains a final condition (in terms of the modulus 
of continuity of a function) for uniform convergence of the Fourier trigonometric 
series of the function, for it is possible to construct a function f (z) satisfying 


i(—z) = f (x) with a modulus of continuity of order O (as ) on [—x, =] 


and with a Fourier trigonometric series diverging on a set of points everywhere 
dense on [—x, x]* 


Under the hypotheses of Theorem 10.15, after a periodic (with 
period 2:1) extension the function f (z) was found to belong to a Hél- 
der class C% on the whole infinite straight line. The question naturally 
arises as to the behaviour of the Fourier trigonometric series of a 
function f(z) belonging to a Hélder class C* only on some closed 
interval [a, b] and satisfying but the ordinary piecewise-continuity 
requirement everywhere outside it. 

The answer to this question is given by the following theorem. 

Theorem 10.16. Let a function f (z) be piecewise continuous on{|—x, x] 
and periodically (with period 2x) extended to the whole infinite straight 
line. Suppose jurther that on some closed interval {a, b] of length smaller 
than 2x it belongs to a Hélder class C% with an arbitrary positive index 
a(<a<1). Then for any 6 in the interval O<5< “5s the 
Fourier trigonometric series of f (x) converges (to that function) uni- 
formly on the closed interval [a + 8, b — 8). 

Proof. Construct a function g (z) that coincides with f (x) on [a, 5], 
is a linear function of the form Az + B on [b, a + 2x] turning inte 
f((b)iwhen z = b and into f (a) when z = a + 22** and that is peri 
dically (with period 2x) extended from a closed interval [a, a + 2x 
to the whole infinite straight line (in Fig. 10.1 the heavy line r~ 





*"A proof of the LEER ewe theorem and a construction of the exir-.. 
just mentioned can be found in the hook: A. Zygmund, Trigonometric S~-.. 
vol. 4, Cambridge, 1959. 

** The condition that the function Ar+-B turns into f(b) whe: -=- 
and into f(a) when z=a-+2x uniquely defines the constants .“ - * 
a a f (a)—f (0) pe (ea) f (o)— Of (a) 


+21—b ’ +21— . : 
a~-21—b a+21—b fe. 
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presents the graph of f (c) and the broken line is the graph of a func- 
tion g (x) constructed from f (z)). 

It is obvious that the constructed function g (x) satisfies the con- 
dition g (—a) = g (x) and belongs to a Hdélder class C* (having 
the same positive index @ as f (x)) on the whole infinite straight 
line*. By Theorem 10.45 and Remark 1 the Fourier trigonometric. 
series of g (x) converges uniformly on the whole infinite straight 
line and therefore by Theorem 10.13 the Fourier trigonometric series 


yk 





Fig. 10.1 


of /{ (x) converges (to that function) uniformly on [a + 6, b ~ 6] 
for any 6 in the intervalO0 <6 < = . Thus the theorem is proved. 

Remark 4. The statement of Theorem 10.16 remains true for 
a closed interval [a, b] of length equal to 2x (i.c. forthe case 
b=a-+-2n), but then in proving the theorem, on fixing an arhi- 
trary 6 in the interval O<5<2, we should take the function 


& (x) to coincide with f(z) on [@ “bh 2 at2a—$], to be Jinear 





6 § ans : A 
on [« 1 2t—~ 3. a4 Qn-b = and perjodically (wilh period 2a) 


extended from [« + Le aida 3] to the whole infinite straight 
line. But if fa, b] is of length greater than 2x, then from / (z) 
belonging toa Holder class C* on such an interval and: from 
the periodicity condition of f(z) (with period 2) it follows that 
f(z) belongs to a class C* on the whole infinite straight line, 
j.e. in this case we arrive at Theorem 10.45. 

10.5.6. On the convergence of the Fourier trigonometric series of 
a piecewise Holder function. 

Definition J. We shall say that a function f(x) is piecewise Holder 
on a closed interval la, b} if it is piecewise continuous on {a, b) and if 
la, b] can be divided by means of a finite number of points a = 2 < 





* It suffices to consider that g(r) is everywhere continuous and that a 
linear function has a bounded derivative and belongs therefore to a Halder 


class C® for any @ <1. 
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Sata. Saye b into subintervals lay, a) (ek = 4, 
2,..., n) on each of which that function belongs to a THélder 
class C™ with same positive index a, (A< a, <1); when defining 
the Hilder class on a subinterval ayy. 2,) the luniling values f (x42 + 
+O) and f (xr, — 0) should be taken as the values of the function at 
the end points of fay. 2) )*. 

In other words, the domain of any piecewise Holder function falls 
into a finite number of closed intervals having no interior points 
in common on each of which the function belongs to a Holder class 
with some pasitive index. 

Each of those intervals will be called a@ smoothness section of the 
function. 

Definition 2. We shall san thata function f(x) is piecewise smooth 
ona closed interval la, bh] if it is piecewise continuous on la, b] and 
has a piecewise continuous derivative on la, b\**, ie. if f(z) is picce- 
wise continuous on la, bland its derivative f’ (x) exists and is continuous 
everywhere an la. b) except possibly for a finite number of points at 
cach of which the function f° (a) has finite right- and left-hand limiting 
values, 

It is clear that any function piecewise smooth on a closed interval 
la, b} is piecewise Holder on it. 

The following main theorem holds. 

Thearem 1047. Leta function f (x) piecewise Hélder on an interval 
I—a, a] be periodically Qrith period 2x) eatended to the whole infinite 
straight line. Then the Fauricr trigonometric series of f (x) converges 
ateach point sof the infinite line to the value f (c) = 1.2 {f (7 — 0) + 
— f(r -- ON, the convergence of that serics being uniform on every 
fied closed interval inside a smoothness section of F (x). 

Proof. The statement of the theorem about the uniform conver- 
gence on every fised closed interval inside a smoothness section 
follows immediately froin Theorem 10.46. Also following from this 
theorem is the convergence of the Fourier trigonometric serics of 
{ (x) at each interior point of a smoothness section of f (r)***. Tt re- 
Mains to prove the convergence of the Fourier trigonometric series 
of f (x) at each point of junction of two smoothness sections. 

Fix one of such points and denote it by a, Then there are constants 
M, and Al, such that for any sufficiently smal] positive z 


Lie tf FOI MM O<y <1), (10.75 





* A piecewise Holder function, as any piecewise continuous function, must 
have values equal at every point zx), (o a half-cum of the right- and left-hand 
limiting values at that point, ic. the equation f (x) = 6/2 [f (x), — U) ++ 
+ f(x, -+ 0)) must hold. 

** See Definition 1 in Section 10.4.2. 

*9* For cach interior point of a smoothness section may be taken as a neigh- 
bourhood of a closed interval inside that section. 
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and for any sufficiently small negative ¢t 

[f(ati)—i(r—0) (SM, (t{% (Oa, <1). (40.76) 
Denote by A/ the largest of the numbers Jf, and AZ, and by a@ the 
smallest of the numbers a, and a. Then, with |Z | < 41, on the right 
of each of the inequalities (10.75) and (10.76) we may write JJ. | t |*. 

Now fix an arbitrary ¢€ > 0 and choose for it 5 > 0 satisfying 
(10.70) and so small that both inequalities (40.75) and (10.76) hold 
for [¢ | <5 and we may take a number AY. | ¢ [* on the right-hand 
sides of those inequalities. Repeating the reasoning of the proof for 
Theorem 10.15 we arrive at equation (10.71) and to prove the theorem 
it remains for us to show that the estimates (10.72), (10.73), and 
(10.74) hold at the fixed point z. In Remark 2 of Section 10.5.5 we 
have noted that the estimates (10.73) and (10.74) hold for any fune- 
tion only piecewise continuous and periodical (with period 2n). It re- 
mains to prove the validity for all 2 of the estimate (10.72). 

Having in mind that f(z) = 1/2 [f (z—0)+f# (x4-0)) and that* 


sin(nt a) Br pote ze ule) oe l soled . 
-6 2sin > 0 2sin> a) 2sin = 


we may rewrite the integral on the left of (10.72) as follows: 


1 sl (n+5)t 
= | tfe+—f(@] ——-— ats 
1t1<6 sin 
4 
‘3 sin{nt=}¢ 
=| fte+9-1e +0) ( z) dt-+ 
0 2sin > 
4 
0 sin(n+—)t 
44 Ju@to-fe- pelea es (10.77) 
“6 2sin = 


sin ( +5) 


2 sin z 
i.e. satisfies p(—t)= 9 (!) for any t. It is easy to see that for such a function 
0 


* In view of the fact that the function 9 (t)= is even, 


fs) 
( @ (t) dt= { @ (t)dt (it suffices to make a substitution t= —r in one of 
5 A 


- 
the integrals) and therefore 


( ewmaaz ( g (t)dt=2 @ (1) dt. 
-6 0 “6 
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To evaluate the integrals on the right of (10.77) use inequali- 
ties (10.75) and (40.76), writing on the right-hand sides of the 


inequalities a number J7|t|°%. Taking into account the estimate 


<a (with {t]<), already applied in proving 
2 sin 


Theorem 10.5, and inequality (10.70) we have 


4° sin(n+z)t 
a \ U(e+)—f(2)] ——>—ai\< 
\tt<6 2sin + 


<4[]tas futa]ed AM Sct, 
-6 


Thus the estimate (10.72) and hence the theorem are proved. 

Corollary 1. The statement of Theorem 10.17 will clearly be true 
if we take a function piecewise smooth instead of piecewise Holder 
(on {—n, z]), periodically (with period 2x) extended to the whole in- 
finite straight line. 

We introduce a new concept to formulate one more corollary. 
Le O<a <i. 

Definition 3. We shall say that a function f(x) satisfies at a given 
point z on the right (left) a Holder condition of order a if f (x) has 
at the point x a right-hand (left-hand) limiting value and if there is 
aconstant M such that for all sufficiently small positive (negative) t 


1f(zt+h—f (z+0) | ’ | f (z+—j (z—9) | 
Hessel <M Coeumera( aeeaea <M), 

It is obvious that if f(z) has at a given point z a right- 
hand (left-hand) derivative understood to be the limit 


[EFN—ICHO (jm LEtI—1e— ) 
t 1+0-0 t : 


lim 

{+040 
then {(x) a fortiori satisfies at that point z on the right (loft) a 
Hélder condition of any order «<c4. 

Corollary 2 (condition for convergence of a Fourier trigonomet- 
ric series at a given point), For the Fourier trigonometric series of a 
piecewise continuous and periodic function f (x) (with period 2m) to con- 
verge at a given point x of an infinite straight line it is sufficient that 
f (x) satisfies a Holder condition of some positive order a, at the point x 
on the right and a Ifélder condition of some positive order a, at the 
point x on the left (and it is clearly sufficient that f (x) a a right- 
hand and a left-hand derivative at the point zx). 


2201684 
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Proof, It suffices to notice that from the fact that f (z) satisfies 
a Hilder condition of order a, (order a,) at a point z on the right 
(left) it follows that there is a constant J/, (a constant AJ,) such that 
inequality (10.75) (inequality (40.76)) holds for all sufficiently sma} 
positive (negative) ¢. But our proof of Theorem 10.17 uses only in- 
equalities (10.75) and (10.76) and the piecewise continuity and perio- 
dicity of f (z). 

Example. Without computing the Fourier coefficients of the func- 
tion 

cosx when —n<z<0, 
f(z)=4 1/2 when z=0, 


Vz when O<zc<a, 


we may state that the Fourier trigonometric series of that function 
converges at a points = 0 to a value of 1/2, for f (x) has at that point 
a left-hand derivative and satisfies at it on the right a Holder condi- 
tion of order a, = 1/2. 


10.5.7, The summability of the Fourler trigonometric serics of a continuous 
function by arithmetic means, We have already noted that the Fourier trigono- 
metric series of an everywhere continuous and periodic function (with period 2x) 
may he divergent (sce Section 10.5.4). We prove that that series is nevertheless 
always summable (uniformly on the whole infinite line) by the Cesaro method 
(or the method of arithmetic means)*. 

Theorem 10.18 (Fejér**). Jf a function { (zr) is continuous on an Interval 
[—2, 7] end satisfies the condition { (—2) = f (m), then the arlihmetic means of 
the partlal sums of tts Fourter trigonometrte serles 


on (x, j= 2o&: A+s; (z, Abe Sncs (x, f) 


converge (to that function) untformly on [—2, x] (,and provided a funetlon with 
period 2x ts extended to the whole tnfintte line, they converge untformly on the whole 
infinite line), 

Proof. From equation (10.55), for S, (z, f) we get 


x n={ 
On(e f= J a [> sin (+ 5) t] dt. (40.78) 


2 
To compute the sum in the brackets of (10.78), sum the identity 


t Ae Vee ' 
2 sin z sin (x+5) t= Cos kt—cos (k-+-1) ¢ 


overnllk =0,4,.-.,n —14. Asa result we get 


n-1 

f he) tat =2 sins 2 
2sin-e Dy sin (K4 5 t=4—cos ni=2 sin 7° 

he 


* See Supplement 3 to Chapter 13 of [4]. 
** 1. Fejér (4889-1959) is a Hungarian mathematician. He proved his 


theorem in 1904. 
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Using the last equation reduces (10.78) to the form 


A + aint 
On (e, f= ( ¢@+0-—+. dl. (£0.79) 
nt 2 sin? — 
2 
From (40.79) it immediately follows in turn that 
4 ¢ sint 
a (| —4at=t, (40.80) 
ne “x 2sint + 
- 2 


for the left-hand side of (40.80) is equal to the arithinctic mean of the partial 
sums of the Fourier trigonometric series of the function f (x) es 1 and all the 
partial sums are identically equal to unity (see Section 10.5.2). 

Fix an arbitrary e¢ > 0. According to Theorem 10.9 (Weierstrass) there is a 
trigonometric polynomial 7 (z) such that 


1 f(z) — T(z) | < 2/2 (10.81) 


for all x of the infinite line. By the linearity of arithmetic means o, (2, /) = 
= G, (xz, f — T) + 6, (x, 7), so that 


1 On (2, ff) — T(z) 1 <1 On (ef — TYE +1 Op (2, T) — T(r) I- (50.82) 
On writing equation (40.79) for the function [f (x) — T (x)} we get, taking into 


sin? 2 
account the nonnegativeness of the function ————— called the Fejér kernel 
2 sin® > 
and using the estimate (10.81) and equation (10.80), 
1 sin? 
lon I-Ie |i e+9-7Te+91——par< 
=n 2sin® z 
t 
N gin? 2 
De ef em, eel Re Ee (10.83) 
2 sn 2 sin? t 2 
=x 4512 > 


Inequality (10.83) bolds for any n. Now notice that the Fourier trigonometric 
series of a polynomial 7 (z) coincides with that polynomtal. It follows that all 
partial sums S, (z, 7) beginning with some integer ng are equal to 7 (x). But 
this allows us to find for the arbitrary e > 0 fixed above an integer NV such that. 


| On (z, T) — T(z) | < 0/2 (40.84) 
for all nN and all z. 

From inequalities (10.82), Ge Ba) and (10.84) we conclude that | o, (2, f) — 
— { (2) | <e for alln > N and all z. Thus the theorem is proved. 

40.5.8. Concluding remarks. 1°. In solving a number of specific 
problems one has to expand the function into a Fourier trigonometric 
series not on the interval [—n, 2] but on [—J, 1] where / is an ar- 


228 
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hitrary positive number, To go over to such a caso it suffices to re- 
7 iT : 
place the variable x by 7r throughout the above reasoning. Of 


course, all the established results will remain valid under such a 
linear change of variablo. They will apply to the Fourier trigonomet- 
ric series 


a 1 Xs ee oe 7 
ot 2 (a, cos + kar + by sin + hz) (10.85) 
ho} 


with the following expressions for the Fourier coofticients 


t 
4 
oom | f(tyat 
-l 


t L + (10.80) 
a+ {feos Lard, = 4 f r)sinZ a at | 

2) * 
(ity By ose). } 


We shall not reformulate any of the established theorems but merely 
note that in all the statemonts the interval [—z, 2) should be re- 
placed by [~/, /J and tho period 22 by a poriod 2/. 

2°. Recall that a function f (x) is said to be even if it satisfies {he 
condition f (~—2) = f (x) and odd if it satisfies f (—x) = —f (x). 

From the form (10.86) of Fouricor trigonometric coefficients it fol- 
lows that for an evon function f (z) all the coofficionts b;, (k = 4, 
2, ...) are equal to zero and for an odd function f (x) all the coef- 
ficients a, (k = 0, 4, 2, ...) are oqual to zoro. Thus an even fune- 
tion f (x) can be expanded into a Fourier trigonometric series only with 
respect to cosines 


~» 
Xt 
P+ s Ap COS a7 he 


het 
and an odd function f (x) can be expanded into @ Fourier trigonometric 
series only with respect lo sines 
~w 
N) sry ep 
St by sin + ke. 
hea} 


3°, We aive a vory frequently used complex notation for tho Fourier 
trigonometric series (10.85). 
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Using the relations* 


p= 


mi 
-i= hx kd SoA at 
t = cos +- kx +i sin = kz, 


ha @ . @ 
u “= cos ku — isin hz, 
it is easy to see that the Fourier trigonometric series (40.85) with 
the Fourier coefficients (10.86) reduces to the form 


oo Pi 3 
ae as (10.87) 


k= 


where the complex coefficients c, are of the form 
r z, 
crag | f(t)e edt (10.88) 
21 


and can be expressed in terms of the coefficients (10.86) by the for- 
mulas 


Gi @p—ib apn iby . 
C=, Cup , c= (k= 1, 2, wea) 


4°. Especially important for applications is the problem of eval- 
uating a function from approximate Fourier coefficients of that 
function. A solution of this problem using the so-called regulari- 
sation method is given in the Appendix. 


10.6. THE FOURIER INTEGRAL 


When a function f (x) is given on the whole infinite line and is not 
periodic whatever the finite period, it is natural to expand it not 
into a Fourier trigonometric series, but into the so-called /ourier 
integral. 

The present section is devoted to the study of such an expansion. 

Throughout it we make the function f (x) obey the requirement 
of absolute integrability on an infinite line (—oo, oo), i.e. we re- 
quire that there should be an improper integral 

fos) 


( | f (x) | de. (10.89) 


. 
—oo 


Let us agree to use the following terminology. 

Definition. We shall say that a function { (x) belongs on an infinite 
line (—0oo, 00) to a class L, and write f (x) € Ly (—0%, 0) if f (x) 
is integrable (in the proper Riemann sense) on any closed interval and 
if the improper integral (10.89) converges. 





* These relations are immediate consequences of the Euler formula estab- 
lished in Section 1.5.3. 
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10.6.1. The Fourier transform and its simplest properties. 

Lemma 4. If f (rz) € L, (—00, 0), then for any point y of an in- 
finite line —co <t y <t co there is an improper integral* 

f= \ f(z) ax (10.90) 
called the Fourier transform (or image) of the function f (x). Moreover, 


the function j {y) is continuous in y at each point of the infinite line 
and tends to zero as | y | 09, i.e. 


lim tf (y)|=0. (10.94) 


Proof. It follows from the equation |e f (z) | = | f(z) |, from 
the convergence of the integral (10.89) and from the Weierstrass 
test (see Theorem 9.7) that the integral (10.90) converges uniformly 
in y on each closed interval of the infinite line, and hence, by virtue 
of the continuity of the function eY in y, it follows from Theorem 9.9 
that the integral (40.90) is continuous in y (on each closed interval, 
i.e. at each point of the infinite line). 

It remains to prove the relation (10.91). Fix an arbitrary e > 0. 
In ey of the convergence of the integral (10.89) we may fix A >0 
such that 


<A co 
| lf@ tact [1 f@ jar<d. (10.92) 
-~« A 


With A thus fixed (by virtue of (10.92)) we have 
oc A 
| {27 (2) dz|<| { 7 (2) d2|4+= (10.93) 
-c -A 


and for the relation (10.91) to be proved it remains for us to 
establish that the integral on the right of (10.93) is less than 


Ze for all sufficiently large | y |. 
Since f (x) is integrable on [—A, A], we can fix a subdivision 7 
of [—A, A} such that for the upper sum Sp of the subdivision** 
A 
0<Sr— | f(zlar<k, (40.94) 
wa 
* The complex function f(y) = u (y) + fr (v) of a real-valued independent 
vatiable y is considered as a pair of real-valued functions u (y) and r (y). The 


continuity of f (v) at a given point y is understood to be the continuity at that 
point of each of the functions u (y) and v (nv). 
** See Sections 10.2 and 10.3 of [4]. 
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Suppose that the subdivision T is made using the points —A = 
=X Oia... <2z, = A and that M, is the supremum 
of f (z) on a subinterval [z,_,, z,] (tk = 1, 2, ..., 2). 

We introduce the function 
My, when 2-,.><2<a, (k=1, 2, ..., 2), 


Fo (a) =| 0 when r=X, (k=0, 4, 2, eves n). 


Since an integral is independent of the value of the integrand in a 
finite number of points, it is obvious that 


A n 
| Fr (2) do= D) Me (ta— 2-1) = Sr, 


-A k=i 
so by (10.94) 
A A 
| tir @—F@) (de= | fr (e)—fede<. (10.95) 
-A -A 


Relying on inequality (10.95) and considering that | e**¥ | =1 and 
*p 


that | j oY dax|<2/ | y | we have 


~Roy 


| f oy (x) de| =| F&F @) Fo () + Fetal dx|< 
-A 


ry 


<| i VF, (x) dx|+| f e* fy (2) —f (2)] de] < 
-A -A 


n *R A 

<Yimel| | eae|+ | he @—f@) lac< 
hai Thy “A 

ce 3 [Mrlti<te 

= yt k 3°35 % 


n 
provided | y i>t|5 | M, |. Thus the lemma is proved. 
hat 
Corollary. If f (xz) € Ly (—oo, 0), then 


lim i cos Az-f (x) dx=0, lim J sin Az. f (x) dr=0. 


—cO 
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10.6.2. Conditions for the expansion of a function into a Fouricr 
integral, 

Definition. For each function f (x) of the class Ly (—0o, oe) the 
limit 


A % «~ 
gina | Fendi ake Jf oe-ny ane 
(provided it exists) is called Uhe expansion of the function into a Fourier 
integral. 

We prove the following main theorem. 

Theorem 10.19 (condition for the expansion of a function at a 
given point intoa Fourier integral). If f (x) € Ly (— 00, 0) and if f (x) 
satisfies a fHélder condition of some positive order a, (0 <a, <1) 
ata given point x on the right and a Hélder condition of some positive 
order a (0 << a@. < 4) on the left, then at that point x 

a 

lim [ e FF (y) dy= fe Oe eo. (10.96) 

Newco oT on 2 

Remark 1. At every point z at which the value of f (x) is equal to 
a half-sum of the right- and left-hand limiting values (in particular, 
at each point of continuity of f (z)) we may write f (x) on the right 
of (10.96). 

Proof of Theorem 10.19. Since the Fourier transform ¢ (y) (in 
view of Lemma 4) is a continuous function of y, for any positive % 
there is an integral 

rs 
{ e-t0F (y) dy = 
?, 


np 


> 


e7ity [ f e!"Vf (u) du] dy. (10.97) 


-—A 


In the integral on the right of (40.97) wo may change the order of 
integration with respect to y and wu (since the inner integral con- 
verges uniformly with respect to y on any interval [—?, 4]). 

Change the order of integration with respect to y and wu, uso 
the equation eC) = cosy (u—2z)+isiny (u—z), 


a a 
( cos y (u—z) dy = aR j sin y (u—z) dy=0 
7. =A 


and make the substitution u= 2 -+ ¢ to get 
. ee 
1 inn? 4 sf 
rd \ emiydy=se | [ ere dy ]f(u) du = 


(sind (u—z 1 ¢ sind 
at | ES payaued | BE etna, 


-—co 
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So for any positive 4 
a 

4 ~ixyt — 

a i f(y) ay 


0 
oe SoM p(etryatyt | sn ney f(c+2) at. (40.98) 


0 








Now note that for any positive % we have the equation* 





co 
{ sin At 
dl t 


0 
at sin At _ tt 
dt=—- and, therefore, { ao dt=—>. 


oO 


It follows from the last two equations that for any positive > 





fet 0) HAF ie ipyse sn g t, (10.99) 





) 
—0 1 in’ 

ir) 2 : f(x—0) 2M at. (10.100) 

Subtracting it (40.98) equations (10.99) and (10.100) we see that 

for any positive A 


a 
{ 07 (y) dy—LEtO41E—9 _ 


a 


== | ite+n—7f e+) St a+ 
0 
0 


+4 | teto-te-o1 a (10.104) 


—oO 


Since f (x) satisfies a Hélder condition of order a, on the right 
and a Hélder condition,a. on the left, there are constants AJ, and 
M, such that inequality (40.75) holds for all sufficiently small posi- 
tive t and inequality (40.76) does for all sufficiently small negative ¢. 
If we denote by J/ the largest of the numbers M, and JM, and by a 
the smallest of the numbers a, and as, then we may write AY |t | 
on the right-hand sides} of (10.75) and (410.76), these inequalities 
being true for all positive (respectively, negative) values of t satis- 
fying | ¢ |< 5, where 6 is an arbitrary, sufficiently small positive 
number. 


* See Section 9.3. 
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Now we may rewrite relation (10.104) as follows: 
a 
[ e-7 (y) dy LE LOE) 


cy 


or. 


>) 
=a) i (2t+1)—f(e+0)) eH ant 





i 
+ | ife+o—f(e—-0 Sag 
-5 
+e) eto Sea- 
ft{2o F 
{(z+-0) ~ sin At {(z—0) ( sind 
— Leto | SM gy — Le) j Se dt. (10.402) 
Fix an arbitrary e > 0 and choose for it 6 > 0 so small that 
ME&* 
se “E 


(40.403) 
Evaluating the first two integrals on the right of (10.102) with the 


aid of inequalities (10.75) and (10.76) (with Af | t |* on the right- 
hand sides of them) we have 





6 
lz [u@+o-1e+0) S¥al< 
os 6 
2 
<= | If(2+)—f(e+0 [ct | {7 dt AB 


and ae similarly 





|~ fr i fe+)—f(2—0) eH al< 
{1 


6 
<é fineto—ne—o cd | yetante 


e Ta ‘ 
=6 


From the last two inequalities and from (10.103) we get 


|= | | Heety—fe+ 0 SH a] 


9 
ae | f@+)—f(2-0) BY ae] <S. (10.104) 


-6 
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To evaluate the third integral on the right of (10.102) we intro- 
duce the function 


Pe are when [¢ [26 
to when |t|<6. 


Since g (t) € Ly (—co, 00), by the corollary of Lemma 4 


: : - 4 i 
hn \ g (t) sin Mt dt = lim — j f(c+1) 2M a =0, 


> CO 





jt jes 
but this means that for the fixed arbitrary 2 > 0 there is A, such that 
|= | f@+y)53 M at |<$ (with ADA). (10.105) 
11126 


Finally note that 

-6 ea ) 

( sin dt= | sin at= | Sint dz—>0 

~00 6 AS : 
as 2 > oo. It follows that for the fixed arbitrary e > 0 and the 
given point z there is A, such that 

00 ~5 

f(z+0) (¢ sin dt f (x—0) sin Xt & 
= op sauce ul ae ae ai a 








(with A>A,). (10.106) 
Denote by A the largest of the numbers A, and A,. From relations 
(10.102) and (10.104) to (10.106) we concluded that 

ry 

| [ tf (y) dy —LETOTIEW9 |< e (with ADA). 

“2 
Thus the theorem is proved. 

Corollary. Equation (10.96) is clearly true if f (x) EL, (— 0%, ©) 
and if f(x) has at a given point x the right- and left-hand deriv- 
atives understood to be the limits of relations lim iether”) 

t+0+0 
( lim feri~ien iE 

t-0— 

Remark 2. The limit on the left of (40.96) may be written as an 
improper integral 

ae | etPy) dy, (10.407) 


80 
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(f(y) is sometimes called a Fourier sine transform), 


2° ysipyz { e* when z>0, 
o=e— —— dl = 
he % | atpye OY 0 when z=0. 


10.6.4, Some further propertics of the Fourier transformation. We shall dis- 
cuss here some further properties of Fourier transformation, frequently encoun- 
tered in applications. 

Lemma 5. For some nonnegative integer k, let a function (1 + [2 {)®-f (x) € 
€ L; (—o, ©). Then the Fourter transform (10.90) of the function f (r) is differen- 
liable k times with respect to the vartable y, it being posstble to compute the dertvattve 
with respect to y of any order m (m = 1, 2, ..., &) by differentiation under the 
integral (10.90), i.e. from the formula 


eo 


ge F = | Ix (i2)™.f(z)dz (m=4, 2 k 10.444 
aye T= | efXU (iz)™.f (x)dz (m=4, 2, ..., k). (40.444) 


Proof. From the inequality 


| a ebsuf (x) [m= | ef. (t2)™ f (2) |< (L412 RLS (2) | 


true for any m (m = 0, 1, ..., &) and from the convergence of the improper 
co 








integral j (A + fx fyk-| f (x) | dz by the Weierstrass test (Theorem 9.7) it 
~—OO 

follows that the integral on the right of (10.111) converges uniformly in y (on 
every closed interva)) for any m = 0, 41, ..., k. By virtue of Theorem 9,40 
this ensures that there is a derivative with respect to y of any order m = 4, 2,. 
..., k and that formula (10.414) is true. Thus the lemma is proved. 

Lemma 6, Let a function f (xz) have at every point x all derivatives up to order 
k Dd inclusively, the function } (x) itself and its derivative of order k betng absolute- 
ly integrable on an infinite line and for any m= 0,4, ..., (hk —4 


mn | amete) | 
Jim [a= |=o. (10.442) 


Then for the Fourier transform fw) of f (z) as |} y | + ©© we have the estimate 
f(y) =o (Ly 17). (10.143.) 
Proof. Consider for any 2 > 0 the integral 


» 
( elxy att (2) dz. 
4 dzk 


Integrating it k times by parts we obtain the formula 


7 [ ty-ety ST oe. 


o oan 


dh~1} (z) 
dzh-1 





2 
° dhf(z) 
j av La =| etev aml 





2 
ee al el xf (2) dz. 


ry 


-2 
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all substitutions vanish we get 


(=) 


spe in the equation obtained 4 approach oo and considering that by (10.142) 
oo 


[ ety EL) dz=(—ty)r [ elav.f (x) dr=(—iy)k-f (y). 


Considering that by Lemma 4 the integral on the left of the last equation tends 
to zero as | y | -+ co we obtain the estimate (10.113). Thus the lemma is proved. 

Theorem 10.20.\Let a function f (x) and its second derivative be absolutely integra- 
ble on an infinite line (—c, 0), the function f (z) itself and its first derivatice 
tending to zero as | z | — co. Also let a function g (x) be absolutely integrable on 
{—cc, 00). Then the following equation is true: 


{ f@r@a=z | 7we Oey (40.444) 


called the generalized Parseval formula or Plancherel* equation. (In (10.114) 
f (y) and g (y) are the Fourier transforms of f (z) and g (x) respectively and g* (y) 


isa pomples conjugate of g (y).) 
. By virtue of Theorem 10.19 at every point z 


Proo 
fase | ef) ay, (10.445) 


the estimate {7 (y)| << C (1+ ] p })~* being true by Lemma 6, ensuring that 
the integral on the right of Go converges absolutely and uniformly (with 
respect to z) on the whole infinite line. 

Multiplying both sides of (10.115) by g (z) and integrating with respect to x 
between —?7. and 7%, we have 


a 1% sd 
| f@e@man-z | cel | fmae. (10.146). 
~~), =A —0 


As pointed out above the integral (10.415) converges uniformly in z and so we 
may change the order of integration with respect to z and y on the right of 
(10.416) to get 

2. 


3 co 2 
J r@e@ar—se [lee car] Fey (10.447) 
~2, -0 —2 


(* stands for complex conjugation). 
By virtue of the inequality 


Ly 
2 
| [\ efxUg (2) dz | 


and the Weierstrass test the integral on the right of (10.117) converges uniformly 
with respect to 7,0n the infinite line —co <7. < co. In (10.117) therefore we 
can proceed to the limit as 7.» o, while proceeding on the right of (10.117) 
to the limit under the integral. Thus the theorem is proved. 


* M. Plancherel (b. 1885) is a French mathematician. 
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10.7, MULTIPLE FOURIER TRIGONOMETRIC SERIES 
AND INTEGRALS 


10.7.1. A multiple Fourier trigonometric Series and its rectangular 
and spherical partial sums. Let a function of V variables f (2, %,... 
-.-, Zy) be defined and integrable in an N-dimensional cube 
—nSmQan (k =1, 2, ..., N). We shall denote that cubo by 
I]. It is convenient to write the multiple trigonometric serics of 
such a function straight in complex form, using the concept of 
a scalar product of two V-dimensional vectors to abridge the nola- 
tion. 

Let x = (2, 22, ..., ty) be a vector with arbitrary real-valued 
coordinates 2, Zo, ..., y, and Jet n= (my, ng ..., Ny) be 
a vector with integral coordinates 1, Ns, ..., Ny. 

The multiple Fourier trigonometric series of a function f (x) = 
= f (%, Xa, .. -» Ly) is a series of the form 


ao eo 
7 ~ 3 
Wo MN Fpecttom, (10.118) 
Ny=—-c Ny =— 00 


where the numbers /,, called Fourier coefficients are defined by the 
equations 


a 


bic tne gen" [ ae | fm, veer UN) X 
e ag - 


Fo eR SL | PR LPO (40.449) 


and (xn) denotes a scalar product of vectors 2 and n equal to 2,7, + 
+ doe a = Ly pe 

Of course a multiple Fourier trigonometric series (10.148) may 
be regarded as a Fourier series with respect to an orthonormal system 
(in an N-dimensional cube [)* formed using all possible products 
of elements of the one-dimensional trigonometric system in variables 
Ly, To, +--+, Ly respectively. It is customary to call that orthonormal 
system a multiple trigonometric system. 

For this, as for any orthonormal system, there is a Bessel ineguality 
which is of the form 


fo] oo 


Sate he <a) | wee | P(t eee ty) day... dtp, 


e 
ny==—00 Ny=-% Nn 


(10.420) 


where f (2), ..., 2x) is any function continuous in an N’-dimen- 
sional cube []. 


* A scalar product of any two functions is defined to be an integral over 1 
of the product of those functions. 
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Consider the problem of convergence of a multiple Fourier trig- 
onometric series. If that series does not converge at a given point 
== (Fy, - + ey Ly) Absolutely, then its convergence (by Thoorem 13.10 
(Riemann) of {411) depends on the sequence of its terms (or equiv- 
alently on the order of summation over the indices 4, ro, ..., My). 
Of wide uso are two methods of summing a multiple Fourier trig- 
onometric series, the spherical and the rectangular one. 
The spherical partial sums of a multiple Fourier trigonometric 
series (10.418) are sums of the form 


8, (a, fy= N free) 
tufec2. 


taken over all integral values n,, mo, ..., Ny Satisfying the con- 
dition [a [ = Vni 4+net...tnga. 

A multiple F ourter trigonometric series (10.418) is said to be si:m- 
mable at a given point x by the spherical method if there is a limit 
lim S A(x, f) at that point. 


d+ 
The rectangular partial sums of a multiple Fourier trigonometric 
series (10.118) are sums of the form 


Sriimgscctiyy Er DSS)  aee DE fuente. 
. nyorm—me Ne rt— I ye 


A multiple Fourier trigonometric series (10. 118) is said to be sum- 
moble at a given point x by the rectangular (or Princegeime) method 
if there is a limit 


lim Syiym,.semy (@, f) 


Myr oo , 
m,70 


at that point (as cach of the indices m,, Mz, ..., My tends to infinity). 

The summation methods both have their advantages and draw- 
backs. Jn considering a multiple Fourier trigonometric series with 
respect to an orthonormal system it is natural to arrange its terms 
in the order of increasing { 2 | and deal with spherical partial sums. 

Rectangular partial sums are used in investigating the behaviour 
of multiple power series near the boundary of the domain of conver- 
gence. It should be noted that the definition of the sum of a series 
ag the limit of rectangular sums (in contrast to the definition based 
on the limit of spherical sums) imposes no constraints on the infinite 
set of partial sums -of that kind. 

Before formulating the conditions for the convergence of a multiple 
Fourier trigonometric series we define some smoothness characteris- 
tics of a function of NW variables. 


2301684 
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10.7.2. The modulus of continuity and Holder classes for a function 
of N variables. Let a function f (x) = f (ty, %, -- +, Zy) be defined 
and continuous in an -dimensional domain D 

Definition 1. For every 5 > 0, the modulus of continuity of a func- 
tion f(x) in a domain D is the supremum of the absolute value of the 
difference | f (x’) — f(x") | on the set of all points x’ and x” in D 
whose distance p (x', x") from each other is less than § 

We shall denote the modulus of continuity of / (x) in D by o (6, /). 

Definition 2. For any « of the half-open interval O<x <1, 
we shall say that a function f(x) belongs in a domain D to a Holder 
class C* with an index % and write f(x) € C“(D) if the modulus of 
continuity of f (x) in D is of order w (5, f) = o (8&*) whenO<2x<i4 
and w (5, f) = O (5) when x = 1. 

Now lIet a be any (not necessarily whole) positive number. We can 
always represent it as @ = r + z, where r is an intoger and ~ is in 
the half-open interval O< 2x <1. 

Definition 3. We shall say that a function f (x) belongs in a do- 
main D to a Holder class C* with an index a > 0 and write f (x)€ 
€ C%(D) if all partial derivatives of f (x) of order r are continuous in D 
and every partial derivative of order r belongs to the class C* (D) intro- 
duced in Definition 2. 

10.7.3. Conditions for convergence of a multiple Fourier trigono- 
metric Series. We first establish the simplest conditions for absolute 
and uniform convergence of a multiple Fourier trigonometric series. 

Theorem 10.21. If a function f (x) is periodically (with period 
2x in each of the variables) extended to the whole of a space EN and 
has in E® continuous derivatives of order s = [N/2) + 4, where [N/2) 
is the integral part of the number N/2, then the multiple Fourier trig- 
onometric series of f (x) converges (to that function) absolutely and 
uniformly in the whole of EX, 
bmy 
ax 


with index n=(n,,...,My)» Integrat- 





Proof. Let us agree to denote by ( 
amy 


m 
Oz hk 


) the Fourier coeff- 
n 





cient of a derivative 
ing zs parts we get (<4) = tiyfr (for any k=1, 2,..., NV), so 
hoe 


that P 5 | (so ook (]m, [+ ...4-[ ty |) and therefore 





ay ae 
Jin l=(mt+-. thax? |(s4),]. (10.12!) 
heli 


Formula (10.121) is true not only for the function f but also for overy 
partial derivative of f up to the order (s — 1) inclusively. 
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This immediately yields the relation 


).| 


(10.122) 


the sum on the right of which is taken over al] nonnegative integers 
Sty Sqr +e oy Sy satisfying 8, + 8. +... + Sy = 8 (so that the num- 
ber of terms in the sum is equal to 'N’). From (10.122) it follows 
in turn that* 


Jin 1S my |e ety IE 


Ns 
Be ss > 


sb... $S ys 


lin IS tte tla Dy [Geers 


Sit. stsy=s = 


~~ 
ast ) ’ 

= . 
: aN n 





i 
ax, so 


Considering that s= te, where e=1 for an even NV and 


e=y for an odd N and that 


(Jy Jee. Ef ey IO (Lm | eee tty I< 


t 2e t 2e 
NS NE ars ie 
<I] saliel 3 


we get from (10.123) 


2e i2e 


Ss -1- 
linI<Gimp ™ edmw] U4 


(40.124) 





Si-.. stsy=s 


For the absolute and uniform convergence of a multiple Fourier 
trigonometric series (10.118) it suffices (by virtue of the Weierstrass 
test) to prove the convergence of the number series 


oo fo] 


De tes Otel 


ny=-0O nyo 


majorizing it, but (by inequality (10.124)) the convergence of this 
last series is a direct consequence of the convergence of the num- 


2 2 
* We use the inequalities |a|-|b| Kote and (ja; |+..-+lep |P?< 
<p(af+...+a3). 
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10.7.2. The modulus of continuity and Holder classes for a function 
of N variables. Let a function j (x) = f (2, m2. .... 2x) be defined 
and continuous in an -dimensional domain D. 

Definition 1. For every 5 > GO, the modulus of continuity of a fune- 
tion f(x) in a domain D is the supremum of the absolute value of the 
difference | f (x') — f (x") |] on the set of all points x and x" in D 
whose distance p (x', x") from each other is less than &. 

We shall denote the modulus of continuity of f (x) in D by w (6, j). 

Definition 2. For any ~ of the haljf-open interval O< zx <i, 
we shall say that a function f(x) belongs in a domain D to a Holder 
class C* with an index z and write f(x) € C“(D) if the modulus of 
continuity of f (x) in D is of order w (6, f) = 0 (5%) uhenO<zux<i 
and w (6, f) = O (6) when « = 1. 

Now let a be any (not necessarily whole) positive number. We can 
always represent it as @ =r -—+ x, where r is an integer and ~ is in 
the half-open interval O0< zx <1. 

Definition 3. We shall say that a function j (x) belongs in a deo- 
main D to a Holder class C* with an index a > 0 and write f (x)£ 
€ C*(D) if all partial derivatives of f (x) of order r are continuous in D 
and every partial derivative of order r belongs to the class C* (D) intro- 
duced in Definition 2. 

10.7.3. Conditions for convergence of a multiple Fourier trigono- 
metric Series. We first establish the simplest conditions for absolute 
and uniform convergence of a multiple Fourier trigonometric series. 

Theorem 10.21. If a function f (x) is periodically (with period 
2x in each of the variables) extended to the whole of a space E* and 
has in EX continuous derivatives of order s = {N/2) + 4, where [N2} 
is the integral part of the number N/2, then the multiple Fourier trig- 
onometric series of f (x) converges (fo that function) absolutely and 
uniformly in the whole of E*. 
ys 
a) the Fourier coctfi- 

n 





Tp 
with index n=(n,,...,Mx)e Integrt- 


Proof. Let us agree to denote by ( 


cient of a derivative 





amt 
Oxy 


ing by parts we get (4) =in,f, (for any k=141,2,...,N), 50 
<p a 


fin (=CUmt+...+ fas |(Z4),]. (10.121) 
ke} 





Formula (10.121) is true not only for the function 7 but also for every 
partial derivative of f up to the order (s — 1) inclusively. 
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This immediately yields the relation 


[fol<(imal+---+lay pn 3 


Sit . - +S ys 





Of 
= ais eel 
(10.4122) 


the sum on the right of which is taken over all nonnegative integers 
51, Sp, » + +) Sy Satisfying s, +s. +... -—+ sy = s (so that the num- 
ber of terms in the sum is equal to *). From (10.122) it follows 
in turn that* 


[fn IS (ey Pb ee tbat 
ie af . 
+ 2 py : eels ax, ). i 


Sib. eS yy 
Considering that sat te, where e=1 for an even N and 





e=5 for an odd WN and that 


(Jy Jone +] ey I= (Jal eee tl tw Ir S 


de 2e 


ig a eae 
Sai Wes [ay | er 
we get from (40.123) 
r 4 Pn ai aee 
lin ly lm] Ne ee | + 
Ns ay ; 
tae a angled (40.124) 
: ae os a)! 


For the absolute and uniform convergence of a multiple Fourier 
trigonometric series (10.118) it suffices (by virtue of the Weierstrass 
test) to prove the convergence of the number series 


oo co 


ae Dy Nel 


ny=- 00 Nys-o 


majorizing it, but (by inequality (10.124)) the convergence of this 
last series is a direct consequence of the convergence of the num- 


2 2 
* Wo use the inequalities |a{-{b | <$4+> and (a; |-bee.-t lap I< 


<p (az... +43). 
23% 
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o or 
is . -i--— 
ber series “’ [ny | N for any k and the convergence of the 
Ny 
series 
oS Fo) aS 
Ds > (Ss)! 
nF 5 Swdn 
nyse ce Aye ory Pare ory 


for any 54, Sa,-..,Sy that follows from the Bessel inequality 


& 
(10.120) for the continuous function at —. 
dzyt... ax,¥ 

The fact that it is to the function f (x) that the multiple Fourier 
trigonometric series (10.418) converges follows from the complete- 
ness of a multiple trigonometric system*. Indeed, if tho series 
(10.418) uniformly converged to some function g (x), then from 
the possibility of term-by-term integration of such a series it would 
follow that all Fourier coefficients of g (x) coincided with the cor- 
responding Fourier coefficients of f(z). But then the differenco 
{f (~) — g(«x)} would be orthogonal to all the clements of the 
multiple trigonometric system and (by the completeness of the 
system) equal to zero. Thus the theorem is proved. 

Remark 1. Theorem 10.24 may be revised. The following state- 
ment is true**: if a function f (x) is periodic in each of the variables 
(with period 2x) and belongs in a space E® toa Hélder class C%, with 
a > N/2, then the multiple Fourier trigonometric series of f (a) con- 
verges (to that function) absolutely and uniformly in the whole space E:%. 

Determining conditions for nonabsolute convergence of a multiple 
trigonometric series requires a finer technique. 


We shall state without proof the conditions for the summability of a mul- 
tiple Fourier trigonometric series hy the spherical and the rectangular method. 

Theorem 10.22. If a function f (ty...) 2x) of N > 2 variables ts periodic in 
each of the variables (with period 2m) and belongs in a space EN to a Welder class c*, 
with o > (N — 13/2, then the spherical partial sums of the multiple Fourler ¢riga- 
nometric series of f (a1, .~. +, Tx) converge to that funetion uniformly in the whole 
space ENs#**, 


* The completeness of the multiple trigonometric system follows immediately 
from the completeness of the constituent one-dimensional trigonometric systems 
the product of which it is. 

** This statement is very simply obtained from Lemma 3.41 proved in the 
paper by V.A. [lyin and Sh.A. Alimov. "Conditions for the convergence of 
spectral decompositions that correspond to self-adjoint extensions of elliptic 
operators, I" (Differentsialnye Uravneniya, Vol. 7, No. 4 (1971), pp. 670-710). 

*** This theorem follows from the more general statements proved in the 
paper “Problems of localization and convergence of Fourier series in fundamental 
systems of functions of the Laplacian operator” by V.A. Hyin (Uspekhi Matema- 
ticheskikh Nauk, Vol. 23, 2 (1968), pp. 61-120) and in the paper cited in the 
preceding footnote. 
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Theorem 10.23. For any positive a less than (N~—1)/2 and any point xy of an 
N-dimensional cube Il there is a function f (x1, t2, ..., Ty) of N > 2 variables 
periodic in each of the variables (with period 2m), belonging in E* to a class cm 
vanishing in some §-neighbourhood of £9 and such that the spherical partial sums of 
the multiple Fourier trigonometric series of that function have no limit at x9*, 

Theorems 10.22 and 10.23 establish final conditions (in Hélder classes C%) 
for the convergence of the spherical partial sums of a periodic function f (zy, .. - 
+++, Zy). According to those theorems there is uniform convergence of spherical 
partial sums when «@ > (NW — 1)/2, but when a < (N — 1)/2 even the principle 
of localization fails to hold for them (however smooth a function f may be in 
a’neighbourhood of zg, its belonging to a class C% (EX) when a < (N — 1)/2 
does not ensure that its spherical partial sums converge at 29). 

Final conditions (in Hélder classes C%) for the convergence of the rectangular 
partial sums of a multiple Fourier trigonometric series have been established by 
L.V. Zhizhiashvili**. 

Theorem 10,24. If a function jf (2, . - .; Zy) of N variables is periodic in each 

\? 
of them (with period 2x) and belongs in EN to a class C%, with anya >O0, then 
the rectangular partial sums of the multiple Fourier trigonometric series of 
f (Za, - . «. pr) converge (to that function) uniformly in EN, 

Remark 2. Note that as far back as 1928 L. Tonelli*** established that the 
continuity alone of a function f (z, . . ., zy) of N > 2 variables fails to ensure 
not only the uniform convergence but also the principle of localization of the 
rectangular partial sums of the multiple Fourier trigonometric series of the 
function (there is a function periodic in each of the variables (with period 22), 
continuous in EX, vanishing in some 6-neighbourhood of a given point 2) and 
such that the rectangular partial sums of that function diverge at 2). 


10.7.4. On the expansion of a function into an V-fold multiple Four- 
ier integral. Let a function of N > 2 variables, f (a, ..., Zy) = 
=f (x), allow the existence of an improper integral 


j wee j f (a, see Zy) dx, eee dzy. \(40.125) 


EN 
Ee 


The Fourier transform of such a function is the quantity 


fn sa und=fy)= J oe \ eur t (ty, -.., Cy) dT, ... dry. 
EN 


In close analogy with Lemma 4 it can be proved that f(y) is 
a continuous function of y everywhere in ZN and tends to zero as 
lyl=Veit... Fay >. 

The limit 


lim { hs J FUty oeoy Uy) CTH) dyy vee Ay (10.126) 


Aveo oye 


* This theorem is a special case of a more general statement proved, in 
Chapter 3 of the paper by V.A. Ilyin cited in the preceding footnote. 
** “On Conjugate Functions and Trigonometric Series” by L.V. Zhizhiashvili. 
Thesis for a Doctor's degree. Moscow: MGU (4967). 
*** TL. Tonelli (4885-1946) is an Italian mathematician. 
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The fact that it is to the function f (x) that the multiple Fourier 
trigonometric series (10.118) converges follows from the complete- 
ness of a multiple trigonometric system*. Indeed, if the series 
(10.118) uniformly converged to some function g (zx), then from 
the possibility of term-by-term integration of such a series it would 
follow that all Fourier coefficients of g (x) coincided with the cor- 
responding Fourier coefficients of f (x). But then the difference 
{f (zc) — g(x)] would be orthogonal to all the elements of the 
multiple trigonometric system and (by the completeness of the 
system) equal to zero. Thus the theorem is proved. 

Remark 1, Theorem 10.24 may be revised. The following state- 
ment is true**: if a function f (x) is periodic in each of the variables 
(with period 2x) and belongsin a space E™ toa Holder class C*, with 
a > N/2, then the multiple Fourier trigonometric series of f (x) con- 
verges (to that function) absolutely and uniformly in the whole space E*. 

Determining conditions for ronabsolute convergence of a multiple 
trigonometric series requires a finer technique. 


We shall state without proof the conditions for the summability of a mul- 
tiple Fourier trigonometric series by the spherical and the rectangular method. 
Theorem 10.22, If a function f (zy... ., 7x) of N > 2 variables is pertodte in 
each of the variables (with period 21) and belongs in a space EN to a Hélder class C*, 
with a S (N — 4)/2, then the spherical partial sums of the multiple Fourier trigo- 
nometric series of f (x1, .. .. 2s) converge to that function uniformly in the whele 


space EN#+s, 


* The completeness of the multiple trigonometric system follows immediately 
from the completencss of the constituent one-dimensional] trigonometric systems 
the product of which it is. 

** This statement is very simply obtained from Lemma 3.1 proved in the 
paper by V.A. IJlyin and Sh.A. Alimov. “Conditions for the convergence of 
spectral decompositions that correspond to self-adjoint extensions of elliptic 
operators, I” (Differentsialnye Uravneniya, Vol. 7, No. 4 (4971), pp. 670-710). 

*+* This theorem follows from the more general statements proved in the 
paper “Problems of localization and convergence of Fourier series in fundamental 
systems of functions of the Laplacian operator” by V.A. yin (Uspekhi Mateme- 
ticheskith Nauk, Vol. 23, 2 (1968), pp. 61-120) and in the paper cited in the 
preceding footnote. 
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Theorem 10.23. For any positive a less than (N—1)/2 and any point xq of an 
{-dimensional cube II there is a function f (11, T2, .- +, Ey) Of N > 2 variables 
periodic in each of the variables (with period 2x), belonging in EN to a class Ge 
vanishing in some 6-neighbourhood of X) and such that the spherical partial sums of 
the multiple Fourier trigonometric series of that function have no limit at x9*, 
Theorems 10.22 and 10.23 establish final conditions (in Hélder classes C%) 
for the convergence of the spherical partial sums of a periodic function f (z,,.. - 
«++. Zy). According to those theorems there is uniform convergence of spherical 
partial sums when a@ > (WN — 1)/2, but when a < (N — 1)/2 even the principle 
of localization fails to hold for them (however smooth a function f may be in 
a neighbourhood of a, its belonging to a class C* (EX) when a < (N — 4)/2 
does not ensure that its spherical partial sums converge at 29). 

Final conditions (in Hdlder classes C*) for the convergence of the rectangular 
partial sums of a multiple Fourier trigonometric series have been established by 
L.V. Zhizhiashvili**. 

Theorem 10.24. Ij a function f (xy, . « -, Zy) of N variables is periodic in each 
of them (with period 2x) and belongs in EN to a class C%, with any @ > 0, then 
the rectangular partial sums of the multiple Fourier trigonometric series of 
f (ay, . . ., 2y) converge (fo that function) uniformly in EN, 

Remark 2. Note that as far back as 1928 L. Tonelli*** established that the 
continuity alone of a function f (x, ..., 2) of N > 2 variables fails to ensure 
not only the uniform convergence but also the principle of localization of the 
rectangular partial sums of the multiple Fourier trigonometric series of the 
function (there is a function periodic in each of the variables (with period 27), 
continuous in E™, vanishing in some 6-neighbourhood of a given point 2, and 
such that the rectangular partial sums of that function diverge at 2p). 


10.7.4. On the expansion of a function into an N-fold nultiple Four- 
ier integral. Let a function of N > 2 variables, f (%,, ..., ty) = 
=f (x), allow the existence of an improper integral 


j tee j f (2, --0) Dy) xy... day. \(40.125) 


EN 
The Fourier transform of such a function is the quantity 


f(s sees yw) =f (y) = \ see \ eu) (xy, «62, Ly) dx, ... dry. 
EN * 

In close analogy with Lemma 4 it can be proved that ?&) is 
a continuous function of y everywhere in ZN and tends to zero as 
lyi=Vet... tam. 

The limit 


lim { et j F(Uss 20s Vy) e7HY) dy, o0. yy (10.426) 


Aco cn 


* This theorem is a special case of a more general statement proved _in 
Chapter 3 of the paper by V.A. Ilyin cited in the preceding footnote. 
** “On Conjugate Functions and Trigonometric Series” by L.V. Zhizhiashvili. 
Thesis for a Doctor’s degree. Moscow: MGU (1967). 
*** L, Tonelli (4885-1946) is an Italian mathematician. 
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(provided that this limit exists) is called the erpansion of the function 
f(z) into an N-fold multiple Fourier integral. 


The following two statements are true*. ; 

1°. Ifa function of NV > 2 variables, f (zy, ..., ry), vanishes outside some 
bounded domain and belongs in the whole of a space EN to a Hélder class C*, 
with a > (NV — 1)/2, then the expansion of that function into an V-fold mul- 
tiple Fourier integral (10.126) converges (to that function) uniformly in the 
whole space E%, ¥ 

2°. For any positive a less than (N — 1)/2 and any point 2 there is a function 
of N > 2 variables, { (z;,. . ., Zy), different from zero only in a bounded domain, 
belonging in E% to a class C*, vanishing in some 5-neighbourhood of zy and such 
that for that function the limit (10.426) does not exist at the point xo. 

Statements 1° and 2° establish final conditions (in Hélder classes a for the 
convergence of the expansion into an N-fold multiple Fourier integral of any 
function equal to zero outside some bounded domain of a space E*. According 
to those statements there is a uniform convergence (in any bounded domain) of 
the expansion into an N-fold multiple Fourier integral when @ > (N — 1}/2, 
but when « < (47 — 1)/2 even the principle of localization fails to hold for the 
expansion into an N-fold multiple Fouricr integral (however smooth a function f 
may be in a neighbourhood of a point xp, its belonging in the whole of E% to 
a class C%, with a -< (N — 1)'2, docs not ensure that the expansion of that 
function into an N-fold multiple Fourier integral converges at z). 


* Both statements follow from the more gencral ones proved in the paper by 
Sh.A. Alimov and V.A. Ilyin “Conditions for the convergence of spectral de- 
compositions that correspond to self-adjoint extensions of elliptic operators, II” 
(Differentsialnye Uravneniya, Vol. 7, No. 5 (1974), pp. 851-882). 


CHAPTER 11 


HILBERT SPACE 





In this chapter we study an important subclass of infinite-dimen- 
sional Euclidean spaces, the so-called Hilbert spaces. 

We establish a special representation, important for applications, 
of any linear function of the elements of such a space (this function 
is generally called a linear functional), we also establish that it is 
possible to choose a subsequence, convergent in some weaker sense, of 
any infinite set of elements of a Hilbert space, bounded in the norm 
{this property is termed a weak compactness of a ball in a Hilbert 
space). 

Particular attention is given to the study of orthonormal systems 
of elements of a Hilbert space. We establish the equivalence for 
such systems of the concepts of closure and completeness intro- 
duced in Section 10.2. and prove the famous Riesz-Fisher theorem 
according to which any sequence of numbers, the series of whose 
Squares converges, is a sequence of Fourier coefficients of some ele- 
ment of a Hilbert space in an expansion with respect to a preassigned 
orthonormal system of elements of that space. In the last section 
we prove that the so-called completely continuous self-adjoint oper- 
ators acting in Hilbert space have eigenvalues. 
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41.1.4. The space 7*. Consider a set whose elements are all possible 
sequences of real numbers (2, 22, -.., Zp, ..-.) such that the 
series made up of the squares of those numbers 


>; ak (44.4) 
koi 
is convergent. The elements of such a set will be denoted (as vectors) 
by semi-bold Latin letters: w= (2, 2, ~~. 5 Uny ++ +)y Y= (Yas Yours 
.. +) Una - ++); and so on. The numbers z,, 22, ..., Zn, .-. will 
be called the coordinates of an element x = (21, %q, .. +; py - + +) 
We define the operations of addition of elements and of multipli- 
cation of elements by real numbers. A sum of two elerrents x = 
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ra (21, Tay + - = Thy ++ -) and Mi Mies (Yas Yor -- +r Yn - -) is an cle- 
ment z= (2, - Uys Mee Bays ay Ly Ung oa ahs UA will be desig- 
nateds =a2-+ y. A product of an element x = (1, Dish oe, edgy Vn ease) 
by a real number % is an element designated Ax or 2% and equal to 
(421, AXey .. +, AZn,. ~~). It is easy to verify that the set we have 
defined is a linear space, i.e. to verify that all the axioms relating 
to the addition of elements and to the multiplication of elements 
by real numbers are true** 

We now introduce in that set a scalar product of any two clements 
@ = (2, Lo, . ~~, En» ---) and y = (Yy, Yay... Yay - +), defining 
it to be the sum of a series*** 

oe 

NS) TaYn- 

R=1 

a 

So we set (z, y) = PET Te It is easy to verify that all the four 


axioms of a scalar product are true. (They can be found in Section 
10.4, and verification of their validity for the space under study 
will be left to the reader.) 

Thus the set we have introduced is a Euclidean space. Following 
the established tradition, it will be designated J*. 

We introduce in 2*, as in any Euclidean space, the norm of every 
element x = (2, Z, -- +; Zn, - ~~), Setting it equal to 


Wel=V@, 2) = Vs 2 The (41.2) 





(Since the series (11.1) is convergent, such a definition is meaningful), 
As usual, two elements of 7? are said to be orthogonal if their 
scalar product is equal to zero. 
Recall that an orthonormal system in a Euclidean space is a sequence 
of elements {e,} of that space satisfying two requirements: (1) any 





* The convergence of the scries S (ene yn)? follows immediately from 


pane 


k=1 


co 
the inequality (zx-+ yn)? <2z%-+2y} and from the convergence of \) zf 
net 


oo 
and >! ie 


K=a! 
ae The formulation of the axioms ofalinear space can he found in any 
course of linear algebra. 
*** The convergence of this series follows from the inequality braun dt < 


<Fltup and from the convergence of 3! zp and 3 UR. 
h=i Asi 
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two elements of the sequence should be orthogonal; (2) the norm of 
each element should be equal to unity. 

We prove that there is a closed (and therefore, by Theorem 10.7, 
complete) orthonormal system in /?*. We show that such a system 
is a sequence of elements 


= (4, 0, 0, ewes 0, wee) 
e,=(0, 1, 0,..., Ha 
as 0, 4, e@eoey 0, sae)'s 


Pr ee Y 


(41.3) 


That this system is orthonormal is obvious (the norm (414.2) for 
every element e; is equal to unity and the scalar product of any two 
elements is an infinite sum of products each of which is equal to 
zero). To prove the closure of the orthonormal system Se 3) it suf- 
fices to establish that for any element w = (a, Zo, . tay 
of 2 its Fourier series with respect to the system (41. 3) converges 
to it in the norm of /?**. 

Since the Fourier coefficients (a, e,) of an element x coincide 
with its coordinates Zp, the nth partial sum of its Fourier series is 


equal to > z,e, and it is sufficient for us to prove that 


n 
lim |] 5) z,e,— || =0. (41.4) 
neo k=t 
But from the definition of the norm (44.2), from the orthonormality 
of asystem {e,,} and from the properties of a scalar product it follows 
that 


n n . n 
| > ner—a[P=( 3 Tpe,— 2, >, ane) 
h=1 k= ket 


n 
= >i ai—2 Dy ty (Cn, 2) + [x |= |] x |P2— Ba) x= 


heal 
oo n Aad 
= a xR— == a Zh, 
kot = kant! 
so that the relation (11.4) follows from the convergence of the series 
(44.4). 


44.1.2. The general form of a linear functional in 1*. We shall 
discuss functions whose independent variables are elements of [* 


ans 
* For the definitions of completeness and closure of an orthonormal system 


see Section 10.2. 
** For then any element - of I* can be approximated to an unlimited precision 


jn the norm of / by partial sums of that Fourier series. 
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and whose values are real numbers. Such functions are usually called 
functional (defined in a space /°*). 
More precisely, our aim is to make a detailed study of the simplest 
functional defined in /, the so-called linear functional. 
Definition 1. A functional 1 (x) defined in a space [° is said to be 
linear if for any elements x and y of and any real numbers @ and f 


L (ax -- By) = al (x) + Bl (y). 


Let a) be an arbitrary element of /*. To geometrize tho termi- 
nology we shall often call the clement x, a point of I*. 

Definition 2. An arbitrary functional I(x) defined in P° is said 
to be continuous at a point x, of l* if for any sequence of elements {x,)} 
of I* converging in the norm of I? to the element x, the number sequence 
U(x,) converges to l (x). 

Definition 3. A functional 1 (x) is said to be continuous if it is 
continuous at each point x of I*. 

Notice at once that in the case of a linear functional I(x) continuity 
at least at one point x» implies continuity at each point x of I". Indeed, 
let a linear functional be continuous at a point x, and let x be an 
arbitrary point of 2. Denote by {a,} an arbitrary sequence of cle- 
ments of /* converging in the norm of 7? to x. Then the sequence {x + 
+ x, — x} converges in the norm of J* to x) and from the conti- 
nuity of the functional at z, it follows that 


1 (tp + 2, — x) +/ (@) when n—-+oo. (14.5) 


But from the linearity of the functional it follows that 1 (a) + 
+2, — 2x) =1 (x) + 1 (a,) — 1 (x). From the last equation and 
from (11.5) we get 2 (z,) 2 (x) as mz —- 00, which just means that 
the functional is continuous at z. 

Definition 4. A functional 1 (x) is said to be bounded if there is 
a constant C such that for all elements x of I* 


Ji(a) |< Ix II. (41.6) 


Theorem 11.1. For a linear functional 1 (x) to be continuous it is 
necessary and sufficient that it should be bounded. 

Proof. (1) Necessity. Let a linear functional Z(x) be continu- 
ous. Suppose there is no constant C satisfying inequality (411.6). 
Then there is a sequence of nonzero elements x}, such that | /(z,)|> 


4 , 4 
Sn? |] eq |] Set yn = wien (Since [lyn —Oll=lyn |=—- 0 
as noo, by the continuity of the functional l(y,)— 1 (0) =0 as 





* For a zero element 0 inequality (41.6) is true for any constant C, for by 
the linearity of the functional 7 (0) = 1 (Or) = O-l (x) = 0. 
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n--oo, but this contradicts the inequality |l(yn) |= San 
%|l(x,) Sn. Thus the necessity is proved. 

(2) Sufficiency. Let a linear functional 1 (w) be bounded, i.e. let 
there be a constant C such that for all elements x inequality (41.6) 
is true. Also let 29 be an arbitrary point of J? and let {z,} be an 
arbitrary sequence of elements of J* converging in the norm of /? 
to a. Then by the linearity of the functional / (#,) — / (a) = 
=1(2, — 29), so that on the basis of (11.6) | 1 (v,) — Ll (a) | = 
=| 1 (a, — a) |<C || a, — al. From the last inequality it fol- 
lows that 1 (2,) —-1 (xo) as n — co. Thus the sufficiency is proved. 

The theorem proved allows us to introduce the norm of a linear 
continuous functional. 

Definition 5. The norm of a linear continuous functional 1 (x) 


x 





is the supremum of a relation Liat on the set of all elements x 
of a space 1?. 
It will be designated || Z |]. 
So by definition 
L}=sup LEN 41.7 
Wek Tel — 


The following main theorem is true. 

Theorem 11.2 (Riesz’s theorem). For every linear continuous 
functional 1 (x) there is one and only one element a of I? such that for 
all elements x of I? 


L(x) = (a, 2), (11.8) 


with lll} = |} a@ |. 

Proof. Let {e,} be a closed orthonormal system (11.3), a,= 
=1(e,) (k=1, 2,...). We show that the sequence of real num- 
bers (a;, @, ..., @,) is an element of /?, i.e. show that the series 


» af converges. 
k= : 


n 
For any n, set S,= py Axe. 
k= 
Then by the linearity of the functional 


n 


1(Sn)= 3} axl (ex) = 3) ak = Sn li® (14.9) 


On the other hand, from Theorem 44.1 and from the definition 
of the norm of a linear continuous functional (41.7) it follows that 


12(Sn) $< We eS (14.40) 
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From (14.9) and (411.10) we get || S, ||< |} 2 || or equivalently 
n 


S ak<ILIP. (44.41) 


k 


Loe] 
The Jast inequality true for any n proves that the series >) af con- 


Lai 
verges, i.e. that the sequence (a,, d2,...-, Gn, ...) is some clement 
of 7? which we denote by a. 

Now let @ = (x1, eo, .- +; Zp, -. -) be an arbitrary element of /°. 
Then by the closure of an orthonormal system (11.3) a partial sum 


n 
of a Fourier series a Z),€, converges in the norm of /*to ras n + &. 


h= 
By the continuity of the functional it follows that 
zt 
1( > 2,e,) ~1(z) as n> ©. 
hat 


But from the linearity of the functional and from the equation 
ay, = 1 (e,) we get 


n n n 

1(S zpex) = S xyl (en) = za. 
R= n= n= 

So we have proved that 


n 
lim “) x,a, =1 (a), 
n+o h= 
but this means that we have established equation (411.8) with a 
uniquely determined element a whose coordinates are equal to /(e,). 


It remains to show that || J || = || a |j. It is}immediate from in- 
equality (41.44) irue for any 7 that 
hell<Ue it (44.42) 


On the other hand, from equation (11.8) we have already proved 
and from the Cauchy-Buniakowski incquality® | (a, z)] < || a{|-{Jz]] 
we get | 1 (x) |< ]l a ||-|] z |] from which by the definition of the 
norm (411.7) it follows that 


W2n<ie ll (11.43) 


From (14.42) and (41.43) we conclude that ]] J |} = |] @ |]. Thus 
the proof of the theorem is complete. 

The theorem establishes a general form of any linear continuous 
functional in P. 


* By Theorem 10.1 the Cauchy-Buniakowski inequality is true for any two 
elements of any Euclidean space. 
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11.1.3. On the weak compactness of a set bounded in the norm of /?. 

Definition 1. A set E of elements of I* is said to be bounded (or 
bounded in the norm) if there is a constant M of elements such that 
jx l]< Mf for all elements x of E. 

Definition 2. An infinite set E of elements of 1? is said to be com- 
pact if we can choose a subsequence {p,} of any sequence of elements 
{x,} of E converging in the norm of I’. 

It is obvious that any compact set E of [° elements is bounded*. 

In a finite-dimensional Euclidean space the converse is also true: 
any bounded set E containing an infinite number of elements is com- 
pact (the Bolzano-Weirstrass theorem). But in an injinite-dimensional 
space, such as J?, the boundedness of an infinite set of elements of E 
no longer implies its compactness. 

For instance, the set {e,} of all the elements of an orthonormal 
system (41.3) is bounded (for the norms of all elements are equal 
to unity), but it is not compact (since for a sequence of elements 
to converge in the norm of /* it is necessary that the norm of the 
difference of two elements with integers k and i + 1 should con- 
verge to zero as k —- oo, and for any subsequence of the elements 
of (11.3) || en — er I? = Ilex I? + ll eri? = 2 given any & and 1 
not equal to each other). 

It is natural to try to introduce the concept of compactness of 
a set in a weaker sense (than in Definition 2) so that any bounded 
set (containing an infinite number of elements) should turn out to 
be compact in that weak sense. 

Definition 3.%A sequence {x,} of elements of a space I* is said to 
converge weakly to an element x, of that space if for any element 
a of ?? 


(fn, @) —>(@p, @) AS N—>O~. 


Notice that the convergence of {x,} to a in the norm of /? and 
the Cauchy-Buniakowski inequality imply the weak convergence of 
{tn} to. 2, since | (t,, @) — (%, @) |= 1, —% BIS 
<Vi 2, — Xp Il-| @ |] for any element a. The weak convergence of 
{x,} to 2 does not in general imply the convergence of {x,} to 2 
in the norm of /?. For instance, the sequence {e),} of all the elements 
of an orthonormal] system (11.3) converges weakly to a zero element 
0, becausejfor any element a of 1* we have the Bessel inequality** 

oo 


2 (e,, a)? <*|J a |P according to which (e,, a) > (0, a) = 0 as 


* Indeed, the boundedness of £ would imply the existence of a sequence of 
elements of FE for which the sequence of norms is infinitely large. Any sub- 
sequence of such a sequence diverges in the norm of J§, which contradicts the 
compactness condition of Z. 

** By Theorem 10.4 the Bessel inequality is true for every element and any 
orthonormal system in an arbitrary Euclidean space. 
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n> co. Moreover, it has been proved above that {e,} does not 
converge in the norm of /°. 

Convergence in the norm of /* (in contrast to weak convergence) 
is often called strong convergence. 

Definition 4. An infinite set £ of elements of i* is said to be weakly 
compact if we can choose a weakly convergent subsequence of any sequence 
of elements {x,} of E. 

The following fundamental theorem is true. 

Theorem 11.3. Any bounded set of an infinite number of elements 
in F is weakly compact. 

Proof. Let £ be an arbitrary bounded subset of [ containing 
an infinite number of elements and let {x,} be an arbitrary sequence 
of elements of £. The condition of boundedness of / allows us to 
state that |j., {|< 47, where AS is some constant. But then it 


Cc 
follows from ]| 2, |] = >! zi, that for any & the number sequence 
het 


= 

of the kth coordinates x,;, of the clements z, is bounded. Therefore, 
by the Bolzano-Weierstrass theorem (sce Theorem 3.3 in [4]) we can 
choose from {zx,} a subsequence of elements {a} such that the 
first coordinates of those elements form a convergent number sequence 
and then we can choose from {x3} a subsequence of elements {247} 
such that both the first and the second coordinates of those elements 
form convergent number sequences and so on. After / steps we choose 
a subsequence of elements {a} in which each of the first / coordi- 
nates form a convergent number sequence. 

Set yn = x7”. It is obvious that {y,}is a subsequence of the orig- 
ina] sequence of elements {x,} and that the sequence formed by 
any coordinate of the elements y, is a convergent number sequence, 
icc. if Yn = (Ynis Unor -- +> Ynhr -- -) then for every / the sequence 
of Yar converges as n -» co. We denote by & the limit of a sequence 
of the kth coordinates of elements yp, i.c. set E, = lim yp, (k = 4, 

Nee 


1-00 
2, ...) and show that the sequence (E;, &, ..., Ex, ...) is some 
~o 


element of /?, i.e. show that the series >) &% converges. Since || tr ll< 
n=! 


iS 
< M for every 7, we have for every 2 
fod 
S yan <A? (11.14) 
kasi 
and clearly 


N 
So oyian<M2 (44.45) 


(for any fixed N and for every n). 
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N 


Proceeding in (41.15) to the limit as m—> co we get > ER< yz 


for any NV, and this means that the sequence (Ey, &, ..., &, ...) 
is some element of J? which we denote by 

It remains to prove that {y,} weakly converges to that ele- 
ment §, i.e. that for any element a = (a,, do, ..., Qn, .-.) of 
Flim (y,, a) = (§, @) or equivalently 

n+ 


lim \) Ynn@n= >) End. 
n-+r00 h=1 k=1 
By virtue of the fact that lim y,, = &, and by the theorem on pas- 


NCO 
sage to the limit term by term (see Theorem 4.6) it suffices to prove 
that the series 


oo 


> Ynr* op (14.16) 
k=l 
converges uniformly with respect to every m. Fix an arbitrary 


&>0. The convergence of >} a? implies the existence of my such 
k=1 
that 


. 


m+p 

By R< oi (41.17) 
h=m+1 
for every m>>mp,) and every natural p (p = 2, +). 


Applying to the remainder of the series (11.16) the pane 
kowski inequality for the sums* 
mt+p m+p m+p 1/2 
1 > ynatal<t Syke SS afl 
hk=m-+1 k=m+1 =m+1 


and using inequalities (14.14) and (11.17) we get 


mip 
| Dy Unndn | <e 
h=m+1 
for every m >> mp, every natural p and for every 7 at once. But this 
means that (41.16) converges uniformly with respect to every n. 
Thus the theorem is proved. 

It has numerous applications. In particular, it is widely used 
in the theory of variational methods of solving problems in mathem- 
atical physics. 





* This inequality has been established in Supplement 1 to Chapter 10 of [4]. 
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11.2. THE SPACE [2 


11.2.1. The simplest properties of the space L*. We are already 
familiar with the space Z* from the study of classes L”, with p > 1, 
in Section 8.4.7. 

Recall that a space Z* (Z) is the set of all functions {f (x)} such 
that every function f (z) is measurablo on a sot £ and every function 
f(z) is summable (i.e. integrable in the Lebesgue senso) on ZL, 
We do not distinguish between functions equivalent on /, consider- 
ing them to be a single element of L* (/). 

L*(£)is briefly called a space of functions with a square summable 
(on a set £). 

Note at once that all the integrals in this section are understood 
in the Lebesgue sense and thal a sot / is understood to be a measur- 
able set of positive finite measure on an infinite line, although the 
entire theory to be presented could be extended without any compli- 
cations to include the case of an arbitrary set of positive measure 
FE in a space of any number vn of dimensions. 

It was established in Section 8.4.7 that a space L* (2) is a nor- 
malized linear space with the norm of any element f(z) of the form 


urii=({ Pe @az)”, (14.18) 


. 
vy 


The space L* (/) differs substantially from all other spaces L? (7), 
with p = 2, in that Z* (/) isa Euclidean space with a scalar product 
of any two elements f (z)"and g (x) of the form* 


(f, a=) f(@) g(a) az. (14.19) 
iE 


The validity in Z°(2) of all the four axioms of a scalar product** 
easily follows from the independence of the product f (x) g (z) 
of the order of the factors, from the linear properties of the integral 
and from the equivalence to zero of a measurable, summahle and 
nonnegative function f* (2). 

Also notice that from (11.18) and (41.19) it follows that in [7 
(as in any Euclidean space) the norm and scalar product are related 


by 


WAl=VGN- 


* For the definition of a Euclidean space and a scalar product soc Section 1044. 
** The axioms of a scalar product can be found in Section 10.1. 
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Finally, recall that it has been proved in Section 8.4.7 that the 
space L? (£) is complete*. 

We now proceed to show the more profound properties of L* (£). 

41.2.2. The separability of the space £?. First consider an arbitrary 
normalized linear space R. 

Definition 1. A set M of elements of a normalized linear space R is 
said to be everywhere dense (or dense in R&) if for any element f of R 
we can choose a sequence of elements {f,} of M converging in the norm 
of R to f. 

Definition 2. A normalized linear space R is said to be separable 
if in it there is a dense set of elements M countable everywhere. 

Our aim here is to prove the separability of L*. 

Theorem 11.4. A set of functions continuous on E is everywhere 
dense in L? (£). 

Proof. Let f (z) be an arbitrary function in L? (£). We may assume 
without loss of generality that f (z) > 0. Introducing two nonneg- 
ative functions 


f= (iF @ +f) FO=F1@I-f@), 


it is indeed easy to see that the theorem is true for any function 
f¢€L* provided it has been proved for nonnegative functions. 
In addition we may assume that f (x) takes on finite values every- 
where. So let f (x) € L° (Z) and O<f (tz) < ~. 
Consider for every 7 a sequence of disjoint sets** 


EL=E| oe <fla< | (=0, 1, 2,...). 
Then obviously for any n(n = 1, 2, ...) the sum of those sets 


over all & = 0, 1, ... yields a set FE, ie. E =U Ek, 
0 


Construct a sequence {f, (z)} of functions defined on £& for every 
n, by setting fy (c) = k/2" for z that is in HR. Thus every function 
fn (z) is a “step”-function on # (taking on at most a countable number 


of values). 
It is also obvious that for every nm and every point z of £ 


O<f (2) —fa (2) < 1/2", 


whence it follows that {f, (x)} converges to f (x) uniformly on £, 
Set W, (z) = min {n, f, (2)}. 


* Recall that a normalized linear space R is said to be complete if for any 
fundamental sequence {f,} of elements of that space (i.e. for a sequence {f,} 
for which lim sup {lfm —/n || = 0) there is an clement f of R to which that 

n-0o men, « 
sequence converges in FR. 
** Recall that the symbol £ [f satisfies condition A) designates a set of all 
points of E for which f (z) satisfies condition A. 
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Every function &, (z) takes on on £ only a finite number of values, 
the sequence {'I, (z)} converging to f(z) everywhere on FE. Since, 
in addition. 0 < f(r) — Vy (xr) < f(z) everywhere on FE, whence 
it follows that [f (c) — Vy (JF < F (x), by the corollary of Theo- 
rem 8.19 the sequence [f (z) — V’,, (x)l- converges to zero in LZ" (£), 
i.e. the sequence of V, (x) converges to f(r) in L* (£). 

It remains to prove that every function V, cr) can be approx- 
imated in the norm of L7(2) by a continuous function to an 


unlimited precision. Recall that every function ',, (x) takes on only 
m 


a finite number of values. i.e. has the form 4, (2) = \ ayw) (x), 
1 


— 


where a, (kK=1, 2,..., m) are constant’ numbers and o) (z) are 
the so-called characteristic functions of the sets £): 


4 ona set &;, 
Os: 0 outside E,. 


Thus, to complete the proof it suffices to construct a sequence of 
continuous functions converging in 4° (/) to a function « (z) of 
the form 


{ on £p, 
w(x) = . 
Q outside £5. 
where /, is some measurable set in £. 
For a set £9 and for any n there are an open set. G, containing Ly 


and a closed set /,, contained in EZ, such that the measure of the 
difference G, — F, is less than 4/n™. 


Denote by F,, the complement of G, and set 


p(t, Fn) 
e(t, Fn)-+ pe (7, Mn) 
where p (z, /) stands for the distance from a point 7 to a set Fy 
It is obvious that every function q, (7) is continuous on /, equal 


to unity on /,, equal to zero on F,, and satishes everywhere the 
condition 0 < @, (zx) <4. Hence we obtain for the norm of the 
difference Gn (Z) — © (7) the following estimate: 


q(t) = 


{Tn- 0 isc = \ (7, (r) —o (2) Pars \ dr< a. (11.20) 
i: Gir, 
which completes the proof. 


We now prove the following main theorem, 
Theorem 11.5. For any bounded measurable set FE a space L? (F) 


is separable. 


i at o,e ewe , 
* Ry the definition of the measurability of a set Ly and the corollary of 
Theorem 8.5 ‘(see Section 8.2.2). 
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Proof. We first prove the case where E is a closed interal {a, 6]. 
We prove that in this case we may take the set JJ of 2]] polyno- 
mials with rational coefficients as a countable everywhere dense set 
in L? {a, b]*. 

According to Theorem 141.4 any function f(z) in L? {{a. 4}) can 
be approximated in the norm of L? (a, b]) to an unlimited preci- 
sion by a continuous function. Further. according to Theorem 1.15 
(Weierstrass) any function continuous on fa, L] can be approxi- 
mated uniformly on that interval (and therefore in the norm of 
[7 ({a.b})) to an unlimited precision by an algebraic polynomial 
with real coefficients. 

Finally, it is obvious that an algebraic polynomial with real] coef- 
ficients can be approximated uniformly on fa, b] and therefore in 
the norm of LZ? ({a. b]) to an unlimited precision by a polynomial 
with rational coefficients. This completes the proof for the case where 
E is a closed interval [a. b). 

Now let £ be an arbitrary bounded measurable set. Since £ is 
bounded, there is a closed interval le, 4] containing E. 

Let 7 (z) be an arbitrary function in L*? (Z). Extend it to fa. 5] 
by setting it equal to zero outside £. It remains to notice that the 
function 7 (xz) thus extended is in L? ([a, b}) and therefore, by what 
has been proved above, can be approximated to an unlimited preci- 
sion in the norm of L? ({a, bj) (and the more so in the norm of L? (£)) 
by polynomials with rational coefficients. In this case too. therefore. 
polynomials with rational coefficients form a set dense everywhere 
in L*(£). This completes the proof. 

41.2.3. The existence in L? of a closed orthonormal system con- 
taining a countable number of elements. To construct in L* a closed 
orthonormal system of elements we shal] assume the existence in 
L? of a countable, everywhere dense set of elements 7;, 72, ... 


. eee ee 


ses Ins 

We shall prove that a closed orthonormal system can be construc- 
ted using finite linear combinations** of elements of the everywhere 
dense set fy, far---2 fins - + + 

Such a method of constructing an orthonormal system is usually 
called orthogonalization process. 

We shall assume that there are no linearly dependent*** elements 
among fy, fo, ---s fn --- (otherwise by successively increasing n 
we should remove out of {/,} every element 7, which is a linear 
combination of f,, fo, .- ++ fn-a)- 

* That such a set Af is countable follows from the countability of a] rational 
Humes and from the countability of the number of all polynomials of different 
egree. 

“28 An element ¥,, is said to be a Jinear combination of elements f,, fo, .- +1 fm 
if there are real numbers 4. 22, . - -- Gp, such that ‘Wy, = af) + tofeg P--- + 


+ Labm: 
*** This means that none of the elements 7, of {7,} is a linear combination of 
a finite number of other elements of {f,}. 
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We construct a system of mutually orthogonal nonzero elements 
» Va, ..., VY, --. such that for any n each of the elements 
Ws We. ..., Uy, is a linear combination of hi. fa - oy fy and, 
conversely, each of the elements f,, fa... +; fy is a linear combi- 
nation of Ws, xg ig Nee 

We prove by mathematical induction that the system of elements 
Ws, Wa, 22, Wn. ... can be successively defined using the rela- 
tions 


Wie fy (11.21) 
(73 V) (fits Y’) Sas (fss Vines) fi 


Ws 22 (fos Y) (fe, V's) sere (fos Vn-1) hs for n>2. (11.22) 


i 


(Fr 1) (fns Vo) ces Ins Vas) fn 


Clearly, the element ’, defined i (11.21) is nonzero (for otherwise 
for any n the elements f;, fo, ..., f, would turn out to be linearly 
dependent). 

Thus for n = 4 all the above requirements are fulfilled. We now 
suppose that the system W,, W.,, ..., Y,-, constructed using rela- 
tions (11.21) and (11.22) satisfies all the above requirements and shows 
that then the system V,, W., ..., Vy constructed using the same 
relations satisfies them as well. 

From (14.22) it is clear that an element V,, is some linear combi- 
nation of f;, fe, for ..-, f, and is thus nonzero (otherwise that 
linear combination would turn out to be a zero element, i.e. the 
elements f,, fa, ..-, fp would turn out to be linearly dependent). 

Further, since the elements f, fa,..., fn-, can be linearly expressed 
in terms of V,, W., ..., U,_, and since the minor in the right- 
hand bottom corner "of the determinant (11.22) of f, is equal to 
{{ Wn. (If" and hence nonzcro, it follows from (11.22) that /, can 
he linearly expressed jn terms of V,, W., ..., Va 

Finally, from (11.22) it follows immediately that the clement 
W, is orthogonal to each of the elements 'V,, Vn, ..., Way. Indeed, 
if k is any of the integers 1, 2, ..., » — 14, then performing senlar 
multiplication of both sides of (11.22) hy Ys, we obtain on the right 
side a determinant whose kth and nth columns are the same. It 
follows from the equality of such a determinant to zero that (Vas 
Wf.) = 9 for all A = 141, 2, ...,n—1. 

This completes the induction and thus the system fj, Ws, ... 
woo Vays. Satisfying the above requirements is constructed. 





* In terms of linear algebra this means that the span of Vy, Wa, o-or Fn 
coincides with the span of f;, fo, . . 

** To show this it suffices to write equation (14.22) for (n — 4) and perform 
the scalar multiplication of it by Y,,_,. 
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On setting now for every n g, = V/ || Vn || we obtain an ortho- 
normal system Q), Qo, -- +: Qny se 

The closure of the constructed system {Qn} follows immediately 
from the fact that each element of the everywhere dense set {f,} 
is a linear combination of a finite number of elements of {qj}. 

From the countability of the everywhere dense set of elements 
hi fer - ++) fay -- it follows that the closed orthonormal system 
constructed contains at most a countable number of elements. But 
the number of elements of that system cannot be finite, for this would 
mean that the space L* is finite-dimensional*. 

This completely proves the existence in L? of a closed orthonormal 
system consisting of a countable number of elements. 

We note in conclusion that a closed orthonormal system of ele- 
ments of L? is often called an orthonormal basis**, 

41.2.4. Isomorphism of the spaces ZL? and 7? and its consequences. 
In LZ? (£), just as in /*, the concepts of weak convergence of a sequence 
of elements and of weak compactness of a set of elements can be intro- 
duced. 

Definition 1. A sequence {f, (x)} of elements of a space L? (E) 
is said to converge weakly to an element f(x) of that space if for any 
element g (x) of L* (E) 


(fans &) >(f, g) as nm—>oo 
or equivalently 


J in (2) ¢ (2) da [ f(z) g(z) de as nos, 
- E 


It can be proved, as elementary as for the case of /*, that convergence 
of {f, (z)} to f (x) in the norm of L* (£) implies weak convergence 
of {f, (x)} to f (x). Of course, the weak convergence of the elements 
of L? (Z) does not imply their convergence in the norm of L* (£) 
(any orthonormal sequence of elements of L* (Z) may serve as an 
example). 

Definition 2. An infinite set M of elements of L? (E) is said to be 
weakly compact if we can choose a weakly convergent subsequence of 
any sequence of elements {f, (x)} in M. 

The concept of linear continuous functional can be introduced 
in L? in a way quite similar to that for /?. 


* That the dimensionality of ZL? (£) is equal to infinity follows immediately 
from the fact that for any preassigned n there are n linearly independent 
elements 1, z, x7, ..., 2%) in L? (BE). 

** A system of elements {q,} is said to be a basis of L*(E) if for any 
element f of L2(£) there is a unique expansion of that element into a series 
hoe) 


5} cngn With constant coefficients cn converging to f in the norm of L?(E). 
n=1 
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Definition 3. A functional I (f) defined on the clements of { of 
L* (£) is said to be linear if for any two clements f and g of L* (E) 
and for any real numbers a and fi, 1 (af +- Bg) = al (f) + Bl (2). 
Let us agree to call elements f, whenever convenient, points of L? (FE). 

Definition 4. A functional | (f) defined on the elements of L* (E) 
is said to be continuous ata point fy of L°(/) if for any sequence {f,} 
of elements of J.* (Ff) converging in the norm of L* (£) to the element 
fo the number sequence | (f,) converges to 1 (fo). 

Definition 5. A functional L(f) is said to be continuous if it 
fs continuous at each point f of 1? (£). 

It is easy 1o prove, as for the case of /*, that if a linear functional 
of L* (Z) is continuous at least at one point of 2 (2), then it is 
continuous everywhere in L* (£), i.c. simply continuous. 

The question naturally arises as to where it is possible to oxtend 
Theorem 11.2 on the general form of a linear continuous functional 
and Theorem 11.3 on weak compactness of any set bounded (in 
the norm) to include the case of L* (£2). 

We shall establish a close connection between LZ? and F which 
bi allow us to immediatoly prove that both theorems aro valid 
or L*. 

We introduce the following fundamental notion. 

Definition 6. Two arbitrary Euclidean spaces R and R' are 
said to be isomorphic if a one-to-one correspondence can be established 
between the elements of Rand R’ so that, provided the elements x’ and y' 
of R' are the images of elements x and y of R, the following require- 
ments are fulfilled: (1) the element x’ --y' of R’ is the image of the 
element x +- y of R; (2) for any real ?. the element 3.2’ of R' is the 
image of the element ?.x of R; (3) the scalar products (x’, y') and (z, y) 
are equal to each other. 

It is established in linear algebra that all 2-dimensional Eucli- 
dean spaces are isomorphic to one another and to the space £". 

The principal aim of Section 11.2.4 is to establish that infinite- 
dimensional Euclidean spaces LZ? (£) and [ are isomorphic. But 
we shall first prove the following remarkable theorem. 

Theorem 11.6 (the Riesz-Pisher theorem). Let {sp,) be an 
arbitrary orthonormal sustem in L?(E)*. Then for any sequence 
of real numbers (€y, Coy «221 nv -++) that satisfies the condition 


aD 


\’ ch <0, i.e. is an element of I*, there is a unique function 

ket 

f(z) in IA(E) such that e,-= (fe Gn) = \ f(x) Gy (x) dx and Sy ch =e 
r ho«f 


~ fi = | f(x) de. 
L 
* Neither the completeness nor, clearly, the closure of the system is acsumed. 
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n 
Proof. Set fn= Sonn: The sequence {f,} is fundamental, 


m 
since for m=n || fm—fa (P= 3 cz and, as stated, the series 
k=n+t 


_ ch converges. But then by the completeness of L?(E) (estab- 
lished in Section 8.4.7) there is an element f of L?(£) such that 


nm 
lim {I fa —7 I= Jim || 3 cnon—fll=0. (11.23) 
From the last relation and from the Bessel identity (10.47) es- 
tablished in Section 10.1* it follows that 


tJ 


n 
lim S) cR=|Ifl?, ie. >) ch=llf Il. 
Noe k= h=t 


We prove that (f, @,) = cp, for any k. To do this notice that by 
the orthonormality of {,}, for all xz >k 


n n 

(fns Pr) = (2 CrP, on) ey Cr (Pt, Pr) = Cry (11.24) 
and that by the Cauchy-Buniakowski inequality 

[fn 2) —(f, Pp) [=| (fa—f Pr) | < 
<Vii Foal =Vhe —Fl 
and by (11.23) 

(fay x) > (fr Pr) aS m —> 00. (41.25) 
From (11.24) and (11.25) we get (f, Qn) = cr for any k. 

It remains to prove that f is a single element of L* (£) satis- 


fying al) the conditions of the theorem. Let g be any other ele- 
ment of L* (£) satisfying all the conditions of the theorem. From 


the Cauchy-Buniakowski inequality | (fr, —f, e) |<V if —filx 
XV Il g || and from (411.23) it follows that 
(fn —f, 8) +9 as no, (11.26) 


But from the equation (g, @,) = cp, and from the scalar product 
axioms it follows that 


43 


(in—f; a= (2 ChPn—f, g)= i cy, (£, Pr) — 


if 


n 


a SYR 
—(; b)= 2 ch (f; g), 





* This Bessel identity is true for any orthonormal system in an arbitrary 
Euclidean space. 
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so by (11.26) 


N ci=(, 8). (11 27) 
From (11.27) and from the relations “’ c= |} ff and “i d= 
i kml 


=IlglP we get 
Wfi—el=G—# f—# =I -20, &) + lek =O. 


But this means that the difference f — g is a zero element of L* (£), 
ic. f = g. This completes the proof. 

Remark. If an orthonormal system {q}, is closed or at least com- 
plete, then the element f is unique even without the requirement 


ao 
that “cf = || f |]? (see in this connection Theorem 10.8). 
fet 


On the basis of the Riesz-Fisher theorem we prove the following 
main theorem. 

Theorem 11.7. L* (E) and F are isomorphic. 

Proof. Choose in £L? (£) a closed orthonormal system {p,} and 
associate with each element f of Z* (2) an element c = (c,, Cs, ..- 
++, Cn, »--) Of F whose coordinates c, are of the form c, = (f, 
gr) (k = 1, 2, ...). By Theorem 11.6 this is a one-to-one cor- 
respondence. 

It remains to prove that if corresponding to the elements f and g 
of 1? (E) are respectively the elements ¢ = (cj, Cg, . ~~, Cny «+ +) 
and d = (d;, da, ..., da, ...) of F, then (4) corresponding to the 
element f-+g is the element ec 4-d = (c, + dy, Cy +- da, ... 
eee, Cy + an, ..-), (2) for any 2% corresponding to if is Ae = 
= (2ey, Pony coe Mens ce 3-0) (8) 

(fy = (er d)= Xi end (11.28) 
(this equation is usually called the generalized Parseval formula). 

(4) and (2) follow immediately from the properties of ascalar prod- 
uct*. We prove (11.28). By the closure of {tp} the following Par- 
seval's formulas are true for f, g, and f + g: 


(1 N= Sch (6) = Si din (54.29) 
(fre ft el= & (end)? (11.30) 


See 
* Thus, to prove (1) it suffices to notice that (ft #9) = (409),) $ (0, 4,) = 
= ¢, + dy. 
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Subtracting (11.29) from (411.30) we get 


2(f, g)=2 D) crdp. 
k=1 


The proof of the theorem is complete. 

Theorem 11.7 allows /* to be considered as coordinate notation for 
the elements of Z* (Z). It extends all the statements established for /* 
to L? (E), and vice versa. 

In particular, it implies the following. 

4°. I? is complete. 

2°. Any set bounded in the norm of Z* (£) and containing an in- 
finite number of elements of LZ? (£) is weakly compact. 

3°. For every linear continuous functional / (f) defined on the ele- 
ments f of L* (Z) there is one and only one element g of L* (£) such 
that, for every element f of Z* (Z), 1 (f) = (f, g) with 


17(f) | 
Lf= = : 
nu fentee) tf fl Nell 





From a quantum-mechanical point of view Theorem 14.7 is a ma- 
thematical justification of the equivalence of Heisenberg’s “matrix 
mechanics” and Schrédinger’s “wave mechanics”, the mathematical 
formalism of the former being the coordinate space /* and of the se- 
cond—the space L? of functions with an integrable square. 

Theorem 11.7 naturally suggests that 7 and L* are both but differ- 
ent specific realizations of the same abstract space which we now 
proceed to consider. 


11.3, ABSTRACT HILBERT SPACE 


11.3.1. Abstract Hilbert space. A Hilbert space H with two partic- 
ular forms of which, J? and L*, we have already got acquainted can 
be introduced axiomatically as a collection of elements X, Y,Z, ... 
of any nature that satisfy a certain system of axioms. 

We enumerate all the axioms which must be satisfied by elements 
of an abstract Hilbert space H. 

I. (a) Axiom on the existence of a rule which associates with any 
two elements X and Y of a space H an element Z of that space called 
the sum of X and Y. 

(b) Axiom on the existence of a rule which associates with any ele- 
mene X of H and any real number ?. an element of J] called a product 
of X by 2. 
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(c) Might axioms of a linear space*, 

IH. (a) Axiom on the existence of a rule associating with any two 
elements X and ¥ of H a number called a scalar product of X and 
Y and designated (X, Y). 

(b) Four axioms of a scalar product**. 

JI. Axiom on the completeness of a space J/ with respect to the 


norm defined by the equation {{ ¥ I] = V(X, X)*t*. 

IV. Axiom on the existence in 77 of any prenssigned number of 
linearly independent elements. 

¥V. Axiom on the existence in H of a countable, everywhere dense 
set (in the sense of the norm of 77) of elements. 

In other words, a Hilbert space JT is any linear Euclidean complete 
infinite-dimensional separable space. 

The following notions are introduced in the Wilbert space Jf: 
(1) convergence of a sequence of elements in the norm and weal: con- 
vergence (a sequence of elements {X,,} is said to converge weakly to 
an clement X if for any Y, (X,, ¥Y) ~(X, Y) as n —+ 00); (2) weak 
compactness of a set Af of elements of // (defined os the possibility of 
choosing a weakly convergent subsequence of any sequence of cle- 
ments of .17); (3) a linear and continuous functionals ? (X) defined on 
the elements X of Hf (1 (X) is said to be linear if 1 (aX +- BY) = 
= al (NX) -+ 62 (Y) for any elements X and ¥ of 7 and any real 
numbers a and $B; /(X) is said to be continuous at a “point” Xq if 
V(X), 1 (Xo) for any sequence {X,} of elements of H for which 
W Xn — NXg || > 0; 7 (X) is said to be continous if it is continuous at 
each point X of 17). 

The existence of a closed orthonormal system of elements {@,} 
can he proved for the abstract Hilbert space 7 in a way quite similar 


* These axioms can be found in any course of Hnear algebra. They are 
listed here for convenience. 

VY + Ys Y-+- N (for any clements X and Y). 

2, N + (Y 4- Al = (X -/ Y) -+ Z (for any elements X, Y and Z), 

3°, There is an clement 0 such that X -- 0 = X for any clement X, 

4°. For every element NX there is an clement X‘ such that X - X’ = 0, 

5°. a@ (BX) = (af)-X for any clement X and any real numbers « and f. 

6°. 1-N == X for any element YX. 

T°. (a-+- Pp) X= aN -+ PN for any clement X and any real numbers @ 
and fi. 
8°. a (XN 4- Y) == @X + aY for any elements X and Y and any real num- 
ber a. 

** Axioms of a scalar product can be found in Section 10.4. They are listed 
here for convenience, 

1%. (NX, Y) = (1. X) for any elements NX and Y. 

2 (x + ¥, Z) = (XK, Z) + (¥,_2) for any elements X, Y, and Z, 

3°. (aN. Y) = a (X, ¥) for any elements X and Y and for any real number a. 

4%. (X, X) > 0 for every nonzero clement X, (0, 4) = 0. 

*¢° For the definition of the completeness of a normalized linear space soo 
Section 8.4.7. 
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to that used in Section 11.2.3 for L? (to do this the orthogonalization 
process for a countable everywhere dense set of elements of A is 
carried out). 

For the abstract Hilbert space H (just as for L?) the Riesz- 
Fisher theorem is true: if {D,} is an arbitrary orthonormal system 
in H and (cy, Co, ..+) Cn, ---) i8 an arbitrary sequence of real 


numbers satisfying the condition 5 cR<Cco, then there is a 
h=4 


single element X in H such that c,=(X, @,) and 3 ch = || X |[*. 


kot 

The proof of this theorem differs from that of Theorem 14.6 only 
in that throughout the reasoning elements of H should be taken in- 
stead of those of Z*. 

The Riesz-Fisher theorem allows the following fundamental theorem 
to be established. 

Theorem 11.8. All Hilbert spaces are isomorphic to one another. 

It suffices to prove that any Hilbert space H is isomorphic to /*, 
and to do this it suffices to repeat the proof of Theorem 11.7, replac- 
ing throughout the elements of L? by those of H. 

The following statements immediately follow from Theorem 11.8. 

1°. Any set bounded in the norm of H and containing an infinite 
number of elements of H is weakly compact. 

2°. For every linear continuous functional L(X) defined on the 

elements X of a Hilbert space H, there is one and only one ele- 
ment Y of H such that for all X of H l(X)=(X, Y), with 


Ree 6:4) ae 


Remark. It can be proved that every weakly compact set JZ of 
an infinite number of elements of H is bounded (in the norm of #). 
In other words, it can be proved that the boundedness of a subset M 
of H containing an infinite number of elemenis is a necessary and suf- 
ficient condition of weak compactness of M. 

11.3.2. The equivalence of the completeness and ‘the closure of an 
orthonormal system in Hilbert space. According to Theorem 10.7 
in any Euclidean space (and therefore in any Hilbert space) any 
closed orthonormal system is complete. We now prove that the con- 
verse is also true in Hilbert space. 

Theorem 11.9. Any complete orthonormal system of elements of an 
arbitrary Hilbert space H is closed. 

Proof. Let {®,} be an arbitrary complete orthonormal system of 
elements of H, and let ¥ be any element of H. It suffices to prove 
that the nth partial sum S, of the Fourier series of an element 
with respect to {D,} converges to that element V in the norm of H. 
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n cc 
™) A CY a 
Let c,=(%', D,), Sp S! c,@,. Since Yc} converges* and 
kez} kaa 


since (by the scalar product axioms and the orthonormality of 
{D,}) for any man 


™ m m 
WSr—Srtt=l] Sea ll=C Lona NS extad)= Sch, 
h=nt{ hentl +4 hent+! 
the sequence {S,} is fundamental. 
But then by virtue of the completeness of H thero is an clement ¥', 
of H such that 
IWS, ~— Vo I] ~0 as n > 00. (41.34) 


It remains to prove that Vy = W. To do this it suffices to establish 
that the clements Y and YW, have tho same Fourier coefficients**. 
Fix an arbitrary k. For any 2 > 4h, by the orthonormality of {,} 
and the scalar product axioms 


n n 
(Say Oy) = (Bes, Oy) =D er (Wr, Op) =e (41.32) 
is = 


On the other hand, since on the basis of the Cauchy-Buniakowski 
inequality 

(Sn; M,)— (Fo, Pr) [=| (S,— Vo, DP)< 

<VTSa— Vol TO W=V NS Volls 
it follows from (41.34) that 

(Sn, @,) —> (Vo, ;,) as n —- 00, 

From this relation and from (11.32) we get (Wo, @;) = ce, == (V, 
(D,.). Thus the theorem is proved. 

Corollary. In a Hilbert space H the completeness of an orthonormal 
system is equivalent to its closure. 

Remark. For an incomplete Euclidean space Theorem 411.9 is in 
general not true. 
The following oxample wil] demonstrate this fact***. 


Consider a Euclidean space C° of all functions f (x) continuous 
on a closed interval [—a, a] with a scalar product defined by 





(i, =f f@elrar. 


cords 


* The convergence of that serics follows, for instance, from the Bessel in- 
equality (sce Theorem 10.10). ; 

** Indeed, the coincidence of all Fourier coefficients of Y and ’pwould mean 
that the element ‘Y — YT, is orthogonal to all ©, and, therefore, by the com- 
pletencss of the system of ®,, zero. 

a** This example is due to Sh.A. Alimov. 
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This space is certainly not complete* (and is not therefore a Hilbert 
space). We construct in that space a complete orthonormal system 
of elements which is not closed. We do this in two steps. 

4°. We first prove that in a Hilbert space L? [—z, zx] there is a 
complete orthonormal system Qo, 1, Qo, -- +s Pn» --~ Such that 
the function , (z) is discontinuous on [—zx, x] and all the functions 
Qn (t), mn = 1, 2, ..., are continuous there. Set 


4 
—= wh O<zr<; 
Yo @={ Vee te Soe (11.33) 
0 when —x<izr<0, 


_ VBeosne 
Won rae (n=4, 2, wee)y 
V Zsin nz 
——=— when —t<r<0, 
Vonit)=\ Va emai a: 


0 when 0X 2x 


Notice at once that the function Y, (x) is discontinuous on [—a, x] 
and all the other functions WY, (z) (n =1, 2, ...) are continuous 
there. Besides, it is easy to verify that Y, (x) is orthogonal on[—z, a] 
to each of Y,, (x) (for alln = 1, 2, ...). 

We show that although the system {W, (z)} (n = 0, 1, 2,...) 
is not a system orthonormal in L? [—zx, «] nevertheless it is comlete 
in the sense that any element f(z) of L? [—a, x] orthogonal to 
every W,, (x) (with n= 0, 1, 2, ...) is equivalent to identical 
zero. 

Indeed, let 7 (z) be any element of L?, [—zx, a] orthogonal to every 
(2) @= 0,1, 2,.« «..). 

From the orthogonality of f(z) to every element of {Pon_1 (x)} 
(n=1, 2, ...) it follows that on [—x, 0] f(z) is orthogonal to 
a system {a } (n=1, 2,...) and therefore, by the com- 
pleteness of that system on [—<x, 0] (established in Remark 1 of 
Section 10.3.2), f(x) is equivalent to zero on [—z, OQ]. 

In such a case the orthogonality of f(x) to every element 
Von (z) (n=0, 1, 2,...) implies that on [0, x] f(z) is orthogonal 





rk 
to a system ——, Veen (n=1, 2,...) and, by the com- 
wT Tv 


pleteness of that system on [0, =] (established in the same Remark 1) 
f(z) is equivalent to zero on [0, x] too. 


* It suffices to fix some function fy (zx) pile vice continuous (but not strictly 
continuous) on [—x, x] and notice that (by Corollary 2 of Section 10.3.3) the 
sequence of partial sums of the Fourier trigonometric series of f, (z) converges to 
fy (z) in the norm of L* [—zx, a]. On the basis of the completeness of ZL? [—xa, = 
that sequence is fundamental. Although each element of the sequence is a function 
continuous on [—zx, =] its limit in L*[—zx, x], the function f, (z), is not in C®% 
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Thus f (z) is equivalent to zero on the whole interval [—x, a]. 

So the system {W,(z)}) (7=O0, 1. 2, ...) is complete in 
L?}—a, a}. Applying the orthogonalization process to the system 
We We Wor eee Way eee, We Oblain an orthonormal system Vi, 
i, Ue, Carne Maye ate ntall remains to normalize the Jast system, 
i.e. fo set* qoee 0, Gye be i (with m=, 2, ...). 


Hf uf 





nf! 

We obtain a complete orthonormal system {i~,} (7 = 0, 4, 2, ...) 
whose zero element qf (x) = Uy (x) is defined by formula (41.33) 
and is a function discontinuous on [—az, x) and all the other ele- 
ments, being linear combinations of continuous functions, are con- 
tinuous on {[—a, =). 

2°. We now return to the space C° of all functions continuous on 
{—z, a} and prove that the system qy, qo, .... Par «++ iS com- 
plete in C® but is not closed in it. 

We first show that {q,} (m =: 1. 2, ...) is complete in C°. Let 
WY be an arbitrary element of C° orthogonal to every q,, with » =: 
=4.2,..., ic. such that 


(VY, pn) = 0, with n= 1, 2,... (41.34) 
Then the function 


f= WV — oo (V, Go) (11.35) 
is an element of ZL? {—z, x] and satisfies the condition** 
Gf, Pn) = 0 for all n = 0, 1, 2,... (41.36) 


By comleteness of {p,} (2 = 0, 1, 2, ...) in Lt f—a, al it fol- 
lows from (41.36) that f is a zero clement, but then from (41.35) 
and Srom the fact that V (2) is continuous and fy (z) is discontinuous 
on [—a, a] it follows that (WV, @) = 0. The last equation in con- 
junction with (14.34) implies that Wf is a zero element, i.e. establishes 
the completeness of {p,} (mn = 1, 2, ...) in C% 

We now prove that {p,} (n = 1, 2, ...) is not closed in C° 

n 

Let P be a polynomial of the form P == eID with absolutely arbi- 
trary coefficients a), (k = 1, 2, ..., ). By the orthonormality of 
{p,} (2 = 0, 1, ...) and by the scalar product axioms 


— Vig. P @woePy— Wie Nei Pile - 
HGo—Pll=Vo—P, t—PY=Vil tole PIES! (44.37) 


* We observe that {{ , ff == f. 
** Indeed, with n = 4.2, ..., (141.36) follows immediately from (11.34) and 
from the arthagonality of ¢q to every q, (n=), 2... .). The equation (f, qe 


follows from (44.35), fram the scalar product axioms and from the fact that 
(or To) = 4. 
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Since a set of continuous functions is everywhere complete in L? (—x, 
nt}, for @o there is a continuous function f (x) such that 


Il Go — Ff I< 1/2. (41.38) 


But from (44.37) and (44.38) it follows that |] f — P |] > 4/2 for an 
absolutely arbitrary polynomial (with any coefficients), and this 
means that an element f of C° cannot be approximated in the norm 
of L? [—x, =) by a linear combination of elements of {p,} (» = 
=4,2,...), ice. that the system {p,} (2 = 1, 2, ...) is not 
closed in C°. 


44.4. COMPLETELY CONTINUOUS SELF-ADJOINT OPERATORS 
IN HILBERT SPACE 


11.4.4. The linear continuous operator. Let H be an arbitrary 
Hilbert space. For convenience we shall label the elements of H 
with small Latin letters z, y, 2, .... 

If there is a rule associating with each element x of H some ele- 
ment y of H, then we say that an operator A from H into H is defined 
and write y = Az. 

Definition 1. An operator A is said to be linear if for any elements x 
and y of H and for any real numbers a and fi 


A (ax + By) = a-Axz + B-Ay. 


As for the case of the functional, we shall (whenever convenient) 
call the elements of H points of H. 

Definition 2. An arbitrary operator A from H into H is said to be 
continuous at a point zp of H if for any sequence {x,} of elements of 
H converging in the norm of H to xp the corresponding sequence {Ax,} 
converges in the norm of H to the element Azp. 

Definition 3. An operator A issaid to be continuous if it is continuous 
at each point x of H. 

Definition 4. An arbitrary operator A from H into H is said to be 
pounded if there is a constant C such that for each element x of H || Ax ||IX 
<C|lz ll. 

Definitions 4 to 4 are closely similar to the corresponding defini- 
tions for the functional in Section 14.1.2. 

This allows us to give without proof the following statement: 
a linear operator A from H into H is continuous if and only if itTis 
bounded. 

The proof of the statement is absolutely identical with that for 
Theorem 44.4. 

For a linear continuous operator A (just as for a linear continuous 
functional) we can introduce the concept of norm. 

Definition 5. The norm of a linear continuous operator A is the 
supremum of the relation || Az || /\| x || on the set of all elements x =~ 0 
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of Hf (or, equivalently, the supremum of || Ax {| on the set of all ele 
ments x of H whase norm || x {{ is equal to unity). 

The norm of a linear continuous operator A will be designated 
{| A |]. So by definition 


JA l[-= sup |] Axl]. (11.39) 
Hextl=4 
xe 


Henceforth throughout this section lincar continuous operators 
are considered. 

Here is an example of a linear continuous operator in Hilbert space. 

Consider a [Hilbort space LZ? [a << t < b} and suppose that we are 
given some function of two variables, A (t, s), defined and conti- 
nuous in the square la<t<b] xX la<s< bj. We prove that 
au integral operator A given on the elements z (t) of L?la<t< bd} 
by 


b 
Az (t) = | K (t, s) x(s) ds (41.40) 


is linear and continuous. The linearity of the operator follows ime 
mediately from the linear property of the integral, 

To prove the continuity of the operator (11.40) it suffices to esta- 
blish its boundedness, for which it is sufficient to establish the fi- 
niteness of its norm (11.39). We denote by 47 a number 


w= f x0 s) at ds |" (11.41) 


and show that {| A {| < Jf. By the Cauchy-Buniakowski inequality 
and the definition of the norm 


b b & 
f Ax (1)? }< | K2(t, sds { 22(s)ds= fai? { K2(t, s) ds. 


a 


On integrating the last inequality with respect to ¢ between a and b 
and using the notation (11.44) we have 


Ax ll < Ar iz |. 


But this implies the boundedness of A and the validity of the in- 
equality {A ||<(4/ for its norm. Note that for some integral ope- 
rators (14.40) || A |] is exactly equal to AY. 

14.4.2. The adjoint operator. We now introduce an important 
concept of adjoint operator. 

Suppose that in a Hilbert space # an arbitrary linear continuous 
operator A from JI into /7 is given. 
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Fix an arbitrary element y of H and consider a functional f (z) = 
= fy (z) = (Az, y) (defined on all elements z of #). It is obvious 
that it is linear and continuous. By the Riesz theorem on the general 
form of a linear functional there is a unique element h = h, of H 
such that f (x) = (zx, h) for every element x of H. 

So we have associated with each element y of H one and only one 
element 2 of H such that fy (z) = (x, h), i-e. we have defined in H 
some operator A* such that kh = A*y. It is this operator A* that 
is called the operator adjoint to an operator A. 

In other words, we arrive at the following definition. 

Definition J. An operator A* is said to be adjoint to an operator A 
from H into H if for any elements x and y of H 


(Az, y) = (z, A*y) (41.42) 


It follows from the above that for every linear continuous opera- 
tor A there is a unique adjoint operator A*. 

It is immediate from Definition 4 that if for an operator A* there 
is an adjoint operator (A*)*, then (A*)* = A. 

We now show that for the case where A is linear and continuous, 
A® is also linear and continuous (and for A* therefore there is an 
adjoint operator and (A*)* = A, the last equation allowing the 
operators A and A* to be called mutually adjoint operators). 

Theorem 11.10. An operator A* adjoint to a linear continuous ope- 
rator A is also linear and continuous, with the norms of A* and A con- 
nected by the relation 


[ A* f= HA Il (41.43) 


Proof. The linearity of A* follows immediately from relation (11.42) 
and from the scalar product axioms. It remains to prove the bounded- 
ness of A* and equation (11.43). 

By (11.42), the relation || Ay [|< || A ll il y |f* and the Cauchy- 
Buniakowski inequality, for any elements z and y of 1 

{(Atz, yy [= ‘(@ Ay I<ie Ay <A Welle Illy Ul 

Inserting in this inequality A*x for y we get for any x of H 

|| A*x |? = (Ata, A*z) < [A Il-l} 2 Ill] A*2 I 


or J A*a P< NA fl z Il ; 
The last inequality implies that A* is bounded and that its norm 
|| A* |] satisfies the condition 


HA* <i Il (11.44) 





* This relation, true for any element y of 1, follows from the definition of 
the norm of aflinear continuous operator A. 
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The linearity and boundedness (or equivalently the continuity) of 
A” ensures the existence of an adjoint operator (A*)* =-1. Repeat- 
ing for that operator the above reasoning we get instead of (11.44) 


HA N< WA* I. (44.45) 


Equationg (11.44) and (14.45) yield (41.43). Thus the theorem is 
proved. 

Definition 2. An arbitrary operator A from I] into H is said to be 
self-adjoint if for A there is an adjoint operator A®* coinciding with A 
(ic. if (Az, y) = (7, Ay) for any elements zx and y of I). 

As an illustration, consider again an integral operator (14.40) 
with some function A’ (¢, s) continuous on the square {a < t < b] X 
<la<s< bj (this function is generally called the kernel of the 
integral operator (11.40)). 

We show that the adjoint of the operator A given by equation 
(11.40) is the integral operator A* given by 

b 
A¥r(l)= | K(s, t)x(s) ds (11.46) 


ry 
a 


(by K (s, t) in (11.46) one should mean the same function as in 
(11.40) but integrated with respect to the first independent variable). 
It follows from ae and (14.46) that for any elements x (2) 


and y (t) of the space L* fa, b) 
a) b 
(Ar, y) = j (| 4 spztsyas) (vat (11.47) 
a a 
i i 
(x, A*y)— ((f Ks) (1) dt) x(s) ds. (11.48) 
1 n 


The right-hand sides of (£1.47) and (11.48) differ only in the order 
of integration with respect to the variables ¢ and s and therefore 
coincide*. Then, so do the left-hand sides and this precisely means 
that the operator A* defined by (41.46) is adjoint to the operator A 
defined by (11.40). 

{t follows from (11.40) and (11.46) that the integral operator given 
by (14.40) is self-adjoint ifand only if A (¢, s) = K (s, 0) for all ¢ 
and sin fa, b}. The kernel A (f, s) satisfying the equation A (f, s) =- 
= K (s, t) is called symmetric. 

We now prove the following statement. 


* Indeed, for continuous functions z (9 and » (t) the equality of the right- 
hand sides of (11.47) and (14.48) is obvious. But then, by Thearein 11.4 and the 
Cauchy-Boniokowski Inequality, this is true for arbitrary elements x (1) and 
u(t) of L? fa, bl as well. 
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Theorem 121.11. The norm \\Ai|\ of a linear continuous self-adjoint 
yperator A is the supremum of |{Az, x) | on the set of all elements x 
of H, with the norm equal to unity, i.e. the norm of A is given by 


Aff sup | (Az, =) |. (£1.49) 
ii! 


Proof. Denote by jt the quantity on the right side of (11.49) (the 
existence of the supremum is obvious). To prove that j= || A |h 
it suffices to establish the two inequalities p < |] A [land p > |{ A |. 

The first of these follows immediately from the fact that on the 
basis of the definition of the norm of an operator and the Cauchy- 
Buniakowski inequality for every clement z for which || z || = 4 


(Az, t) |< [J Ax |J- [el] = Az <A ff. 

It remains to prove the inequality wu > ||A ||. Since the partons 
is inear, for each element z of H* 

| (Az, z) |< pelle |p. (11.50) 
Further, it follows from the scalar product axioms and from the self- 
adjointness of the linear operator A (i.e. from (Az, y) = (x, Ay)) 
that for any elements z and y of H 

4(Az, y)=(A(a+y), e+y)—(A@—y), e—y). 
From this equation and from (11.50) we get 

4\(Az, y)lowefiety P+ etice—y iP = 2p (ie P+ 

+ iy IP). 

From this last inequality it follows that for arbitrary elements x 
and y of Jf for which |{ z |] = lly || = 4 

| (Az, y) |<. (14.54) 


On setting in (41.54) y = Azi/|| Az || we get, for every element x 
for which || z |] = 4, (Az, Az)/|| Az |] <p and therefore || Az || < 
<u. Hence {{f A {| < pn. Thus the theorem is proved. 

11.4.3. The completely continuous operator. 

Definition. An operator A from H into H is said to he completely 
continuous if it maps each set, bounded (in the norm), of elemenis of H 
into a compact set. 

In other words, A is said to be completely continuous if for any 
sequence {x,} of elements of H such that || z, || < C = const there 
is a subsequence {z,,} (k = 1, 2, ...) such that t the it 
subsequence {Az,,} converges in the norm of H. 

Recall that a linear operator A is continuous if and only if it is 


* Since for every clement zp= 
| (Az, 20) 1 <p. 
25* 





‘z with the norm equal to unity 


4 
EZ) 
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bounded, i.e. ifand only if it maps any set bounded (in the norm of H) 
again into a bounded set. Since a compact set is bounded*, any com- 
pletely continuous operator is continuous. It should be added that 
not any continuous linear operator is completely continuous. For 
instance, an identity operator / of the form Ex = z is continuous, 
but it is not completely continuous: it suffices to consider the mapping 
of a bounded noncompact set to see this. 

We prove the following lemma. 

Lemma. Let A be a linear completelu continuous operator jrom H 
into H. Also let {z,,} be an arbitrary sequence of elements of If weakly 
converging to an element x, and such that \j z,, || = 1 for all n. Then 
the sequence {Az,} converges to the elements Az, in the narm of H. 

Proof. Since A is linear and completely continuous**, according 
to Section 11.4.2, there is an adjoint operator 4* and for every cle- 
ment z, and an arbitrary element uv (Az,, v) = (z,, A*tu). From 
this and the weak convergence of {z,} to Zy we get H (Az,, y) > 
—(Z). A*y) = (Azo, v) for any element y of H as n — 0, and this 
means that {:z,} weakly converges to Azo. 

We now prove that {z,} converges to Az, also in the norm of ff. 

Suppose {Az,} does not converge to Az, in the norm of Hf. Then 
there is e > 0 such that for some subsequence of elements {z,,} 


(eS e225) 
|| Arn, — Az flee. 11.51’) 


Since 4A is completely continuous and |] z, {| = 1 we can choose a 
subsequence {z,} (p = 1. 2,...) of {7m,} such that the corre- 
sponding subsequence {Ax,,} converges in the norm of /7. Since by 
what was proved above {Az, *} converges weakly to Azy, it also con- 
verges to Az, in the norm of #7. But this is contrary to inequality 
(11.51) true for every m, (and clearly for every 7). 

This contradiction proves the lemma. 

Remark. The above lemma is a consequence of a more general state- 
ment: an operator A from H into H is completely continuous ij and 
only if it maps anu weal:ly convergent sequence {z,} of elements of H 
into a sequence {Ar,} converging in the norm of H. 

We shall leave this statement unproved. 

We now show that an integral operator A given by (114.40) (with 
kernel A (t. s) continuous in the square la <t<b) x la<s <b) 
is a completely continuous operator. 

Let {z, (t)} be an arbitrary sequence of elements of ZL? fa. 01 
bounded in the norm of L* fa. b), i.e. such that for every n 


Hz, (@) I< C. (44.52) 





* See Section 11.1.3. 
** And therefore continua. 
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It suffices to prove that the corresponding sequence of functions 
Yn (t) = Az, (t) is uniformly bounded and equicontinuous on [a, 5). 
(Then by Theorem 1.12 (Arzela) we can choose a subsequence of 
that sequence converging uniformly on [a, b] and, the more so, in 
the norm of LZ? [a, b}). From (44.52) and the Cauchy-Buniakowski 
inequality we get 


[yn () (=| { K (t, 8) 2 (8) asl<[{ K2(, sds] 


which proves the uniform boundedness of {y, (t)} on [a, b]*. 

Notice further that it follows from the continuity and, hence, the 
uniform continuity of the kernel K (t, s) on the square la <t < b] X 
x es s <b] that given an arbitrary « > 0 we can find 6 >0 
such that 


K — K (te —— 11.53 
| K (ty, s)—K (ty, 8) | SG ( ) 
for every s in [a, b} and every ¢, and ¢, in {a, b) such that [4 — 
~—ti<. 
From (44.52) and (44.53) and from the Cauchy-Buniakowski in- 
equality we get 





6 
[Yn (te) —Yn (44) 1S | 1K (ley 8) —K (tas 8) [+ | tn (6) | ds< 





dv oO 
& & —_— 
<5 | [an (8) [dso pelt nV Gase 


for every t, and ¢, in [a, b] such that | t, —%. |<. 

The last inequality proves the equicontinuity of {y, (t)} on la, 0] 
and, by virtue of the foregoing, completes the proof that the operator 
(11.40) is completely continuous. 

11.4.4. Existence of eigenvalues of a completely continuous self- 
adjoint operator. 

Definition. A real number i is said to be an eigenvalue of an ope- 
rator A oe there is a nonzero element x of H satisfying the condition 
Ax = dz. 

That element x is a proper element of A corresponding to the eigen- 
value i. 

If A is linear, then it follows from the condition that z is a proper 
element of A corresponding to an eigenvalue A that whatever the 
nonzero real number @ the element az is also a proper element of A 


* It suffices,to notice that the kernel K (f, s) is continuous on the square 
joxt<b] X{acs< Dd]. 
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corresponding to the eigenvalue %. It is natural therefore to consider 
all proper elements of a linear operator A to be normalized, i.c. to 
satisfy the condition {fz f] = 1. 

The importance of the notion of proper elements lies in the fact 
that the action of an operator on them reduces to multiplication by 
some constant 2. 

Not every operator A has cigenvalues*. 

We prove the following main theorem. 

Theorem 11.12, Every linear self-adjoint completely continuous ope- 
rator A from fT into IT has at least one eigenvalue 3 satisfying the con- 
dition [4 | = |[ A |]. Of al? the eigenvalues of A it is the largest in 
absolute value. 

Proof. Denote by Af and m respectively the supremum and infimum 
of the scalar product (Ax, z) on the set of all elements z of J/ satis- 
fying || z || = 1, i.e. set 


M= sup (Az, 2), m= inf Az, =). (11.54) 
Uxll=-3 IxI==4 
xin MEH 


For definiteness we consider the case {Af | > [mm {[ (the case { Af [<< 
<|m | can be considered quite similarly). 

Since | AJ {>> ]m jf, 1 > 0. We prove that the number 2, = Jf 
is an ciyenvalue of A. 

By the definition of the supremum there is a sequence {z,} of ele- 
ments of HW such that (Az,, z,) ~% and |{z, || = 4. Since {z,} 
is hounded (in the norm of /7), by the theorem on the weak compact- 


* For instance, the integral operator (11.40) has no cigenyvalue when 
no 


a=:0, bea, K (7, s)= NI 2-" sin (n-+-4) zsinns. Indeed, let @(z) be an arbi- 
n=-{ 


rag 
trary element of £240, 2) for which \ K (x, s)+@ (s) ds= 49 (xz) and Iet {by} 
ny) 


be Fourier coefficients in the expansion of (z) with respect to a complete 
73 si 
system {ta} orthonormal on (0, a). If 2=:0. then from the gene 
st 
} fs of 
ralizell Parseval formula v 2-"h, sin (ati) r=O, whence all ba=0 and 
n= { 


7 
Gg (z)~ 0. But if ?% 40, Shen from the equation j K (xz, s) p(s) de = 4.9 (2) 


a 
and from the properties of the kernel A (7, s) ensuring uniform convergence 
wm 


tw 

of the Fourier series of q@(z) we get NY 2-6, sin(n = i)z-% \ by sinns. 
n--4 nial 

Since #4, i¢ follows from the last equation that every b,=0 and 


@ (7) = 0. 
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ness of any infinite set bounded (in the norm of #H) there is a sub- 
sequence of {z,} weakly converging to some element zr, of H. We re- 
number that subsequence, i.e. denote it again by {z,}. So {z,} con- 
verges weakly to x, of H. But then (by the lemma of Section 11.4.3) 
{Az,} converges to Az, in the norm of H. 

Since A is self-adjoint, (Az,, Xo) = (fn, Az,), from which it 
follows 


(Ap, In) — (Ax, Xp) = (A (fn — Zp)> (Zn + Zo))- (11.55) 
Applying the Cauchy-Buniakowski inequality (11.55) yields 
1{A%n, Zn) — (AX, Zo) |< Men + Zo HI] Az, — Ax |] +9 


(for {Az,} converges to Az, in the norm of 47 and || z, || = 1). 

We have thus proved that 

(A&_, L_) > (Ax, Zo). (11.56) 
From this and the relation (Az,, Z,) >A it follows that 

(At, Xp) = 4. (41.57) 
We now show that || 9 || = 1. By the Cauchy-Buniakowski in- 
equality | (t,,y)|<Il2n {l-Ily Il = ly { for any element y. Pro- 


ceeding in the last inequality to the limit ag n —- oo and consid- 
ering the weak convergence of {z,} to zr) we get | (x, y) |< {ly ll 
{for any element y). From this last inequality we get || x» |}<4 
when y = Zo. To prove that || 2 {| = 1, it suffices to show that the 
assumption that 0 < || x || <1 holds leads to a contradiction. 

Let 0 < |[ zp || <4. Set yo = %o/|{ Zo ||. Then || yg || = 1 and by 
the linearity of the operator and relation (11.57) 


4 vy 
(Avo: Yo) = To 1? (Az, Xp) = T= > 





and this (considering that ) = M) contradicts (41.54). So |] 2» || = 4. 
We now prove that x, is a proper element corresponding to an eigen- 
value 4. 
Using the definition of the norm of an element, the scalar product 
axioms, equation (11.57), and the definition of the norm of an ope- 
rator yields 


If Axy— Az |]? = (Azy—Ax, AT) —Ax)) = 
= || Ax ||? — 24 (Azo, Zp) + A? |] Xo ||? = |] AIP —A2. 


By virtue of Theorem 11.11 the right-hand (and therefore the left- 
hand) side of the last relation is zero. But this means that Ary = )2, 
i.e. that 2, is a proper element of the operator A corresponding to an 
eigenvalue A. 

In the case | Af |< |] m | the reasoning is similar, but 4 should 
be set equal to m. 
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The only thing that remains to be proved is (hat if there are other 
eigenvalues, then the eigenvalue 7 satisfying the condition [4 [ == 
r= {jsf {[ is the Jargest of them in absolute value. Let 2, be some 
other eigenvalue and let z, be the corresponding normed proper cle- 
ment. Then Az, = 4,2, and therefore (Az,, 2) = 4,. But then it 
follows immediately from the relation” 


}@}== sup | (Ax, z)] 
ali 


that [2% | 2 [41 

Thus the proof of the theorem is complete. 

Using the theorem just proved we consider the so-called Fredholm 
equation of the second kind, i.e. the relation 


h 
x(t) =) K (t, s)x(s)ds (11.58) 


from which given a kerne) A (¢, s) a function f (t) different from iden- 
tical zero is defined as well as those values of the parameter ge for 
which such a function exists. Those values of jt for which there are 
solutions z (f), not identically zero, of the integral equation (411.58) 
are called eigenvalues of that equation. Every nonzero solution of 
(11.58) corresponding to a given eigenvalue is an elgenfunction of 
that equation. 

The inverse of an eigenvalue of the integral equation (14.58) 
is generally called a characteristic number of the equation. 

Obviously, if we introduce into consideration an integral operator 
A given by equation (11.40), then the eigenvalues of A are character- 
istic numbers of the integral equation (11.58) and the corresponding 
proper elements of A are the eigenfunctions of (11.58). 

It has been proved in Sections 11.4.4 10 41.4.3 that if the kerne] 
K (t, 8) is continuous in the square la<it<b) x la<s<b) 
and symmetric, then the operator (11.40) is linear, self-adjoint and 
completely continuous. 

By Theorem 11.12 the integral equation (41.58) with such a ker- 
nel A (t, s) has at least one characteristic number. For equation 
(11.58) to have at least one eigenvalue it should he required that it 
should have at least one nonzero characteristic number for which 
the condition that A (1, s) does not become an identical zero** should 


* This relation follows from (41.54) and from the fact that 2 = Af when 
| Af) > | my and % =: m when | af] < | mf. 

** The condition that the continuous kernel A (1, 5) does not become an 
identical zero is a necessary and sufficient candition for an integra) operator A 
defined by (§1.40) to have nonzera cigenvalues. Indeed, by Theorem 14.12 
YAW == [Af], where 4 is the largest absolute eigenvalue of A, so that it suffices 
to prove that {1A f{ s= Oif and only if A (1, s) isnot identically zero. If HK (t, 2) e+ 
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be added to the requirements that K (t, s) should be continuous and 
symmetric. 

So we arrive at the following fundamental statement: if the kernel 
K (t, s) of the Fredholm equation of the second kind (41.58) is conti- 
nuous in the square fa << t<b!] X laxs< bd], symmetric, and is 
not identically zero, then the equation has at least one eigenvalue. 

Remark. We could prove that the above statement is also true- 
if the requirement that X (, s) should be continuous on la<t< 
<b] xX la<s< bd) is replaced by a weaker one, that there should. 
be a finite integral 

bb; 


\ \ K2(t, s) it ds. 


(It suffices to show that when that weaker requirement holds the- 
integral operator (14.40) from LZ? [a, b] into L? {a, b] continues to- 
be completely continuous.) 

11.4.5. The basic properties of the eigenvalues and proper elements. 
of a linear completely continuous self-adjoint operator. In conclusion 
we discuss the basic properties of the eigenvalues and proper ele~ 
ments of an arbitrary linear completely continuous self-adjoint 
operator from H into H 

1°. Proper elements x, and x. corresponding to two different eigen- 
values i, and id, are orthogonal. 

Indeed, on the basis of the properties of a scalar product, the equa- 
tions Az, = A42,, Az, = Agro, and the self-adjointness property: 
of the operator A we get 


(hq — Ya) (ty, Xo) = (Age, Zo) — (yy Agte) = 
= (Az, 2) — (a, Az.) = 0. 


Since A, =& Ag, from the equation obtained it follows that (a, %) = 0. 

2°. There may be several proper elements of A corresponding to- 
the same eigenvalue 4. We prove, however, that any nonzero eigen- 
value & may have corresponding to it only a finite number of linearly: 
independent proper elements*. 

Suppose that there are an infinite number of linearly independent 
proper elements corresponding to some A =4 0. On carrying out the- 
orthogonalization and normalization process for those elements we- 





= 0, then clearly j/|A || = 0. But if, conversely, {| A || = 0, then the operator A 
given by (11.40) maps all nonzero elements of L*[a, b] into the zero element 
and in particular it maps into the identical] zero all the elements {z, (t)} of some- 
complete orthonormal system in Z* (qa, 6]. But this means that K ({t, s) = 0. 

* The zero eigenvalue A = 0 may have corresponding to it an infinite number 
of proper elements, too. For instance, for the integral operator (14.40) with 
K (t, s) identically zero each element of some orthonormal system, {z, (t)} of 
elements of L? [a, b) isa proper element corresponding to the eigenvalue 2 = 0. 
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obtain an infinite orthonormal system of elements {7,} in W, each 
a proper element of -t corresponding to an eigenvalue 4% 0. Since 


x 


for any element y of 17 the Bessel inequality = (ta, uy < Iba dF 


no 
is true, lim (z,, v) = 0 = (0, y), ie. the sequence of proper cle- 
Nw 

ments {v,} weakly converges to the zero clement Q. But then it fol- 
lows from the condition that the operator A is completely continuous 
and from the lemma of Section {1.4.3 that the corresponding sv- 
quence {-lz,} converges in the norm of H to the element 1 0 = 0. 
By virtue of the relation -lz, = Ar, we get [A | = ff iz, |] ~0 
(as rn — oo), which means that [2 | = 0 and contradicts the condi- 
tion 2 5£ 0. This contradiction proves that every 2% 32 0 may have 
corresponding to it only a finite number of proper elements. 

The above reasoning also shows that all proper elements (hoth 
corresponding to the same eigenvalue % and to differeut 2) may he 
considered to be mutually orthogonal (and to have norms equal to unity). 

3°. We now prove that if an operator -\ has an infinite number of 
eigenvalues, then any subsequence {in} of eigenvalues ts infinitesimal, 

Let {2,} be any sequence of eigenvalues, and let {z,} be the cor- 
responding sequence of proper elements which (by virtue of the rea- 
soning followed in proving Property 2°) may be considered to be 
orthonormal. Writing for any element y of f7 the Bessel inequality 
with respect to the system {r,} we see thal {zt,} weakly converges to 
the zero element. Since the operator A is completely continuons, 
it follows from the lemma of Section 14.4.3 that the sequence {2x} 
converges to the zero element in the norm of 77. But then the equa- 
tion Az, = 4,27, has as a consequence the relation 


]an | = |] dz, |] +0 (as 2 + oo), 


Property 3° allows us to state that the eigenvalues of a linear com- 
pletely continuous self-adjoint operator have no other limit points on 
the number axis except for the sero point*., 

This means that al? eigenvalues may be numbered in the arder of 
their non-increasing absolute values, so that 


[ay Le Lae be tas bee len Le ees 


with | 2, | +0 as n —+ 00, 

Tn particular, all the properties we have established are true for 
the eigenvalues and characteristic numbers of the Fredholm equa- 
tion of the second kind (11.58) with a kernel A (¢, s) that is conti- 
nuous on the square la < tb) x las < bi and symmetric. 





* For any ¢ > Oftherofmayjbe only a finite number of eigenvalues outride the 
interval [(—e, €). 


CHAPTER 12 


FUNDAMENTALS OF THE THEORY 
OF CURVES AND SURFACES 


In this chapter we present some facts about curves and surfaces 
of importance for applications. 


12.1. VECTOR FUNCTIONS 


12.1.1. The vector function*. We introduce the concept of vector 
function of m variables. 

If each point M of a set {M} of points in an m-dimensional Eucli- 
dean space E”™ is assigned according to a certain law some vector r**, 
then a vector function r = r (MM) is said to be given on {MM}, the set 
{1}} being the domain of r = r (MM). If p = m, then, as in the case 
of m = 2 or m = 8 (see Section 6.2.1), a vector field defined by the 
vector function r (4) is said to be given on {AZ}. 

The vector r (Af) corresponding to a given point AZ of {44} will 
be called a particular (or special) value of the vector function at the 
point M. The collection of all particular values of r (J) is called 
the set of values of the function. 

If {12} is a set of points on a given straight line and {u} is the set 
of their coordinates, then r (7) may obviously be considered as a 
vector function of a single scalar variable wu: 


r=r(u). 
If, however, {1%} is a set of points in an m-dimensional space and 


(uj, Ua, . . ., Um) ate the coordinates of a point M, then r (MM) is a 
vector function of the scalar variables wy, U2, ..., Um? 


r=P (uy, Ug, ..-, Um) 


Remark. Let {7,, 72, . . -, "p} be the coordinates of r (M). Obvious- 
ly, giving a vector function r (//) is equivalent to giving p scalar 
functions r, (M), re (Mf), . . ., rp (M4). 

Let vectors r (Jf) be in an Euclidean space Z?. We shall assume 
that the initial points of those vectors coincide with the origin of the 
Cartesian system chosen in £?. In this case the point set of the end 
points of r (iM) is called the locus of r (M1). The locus of a vector 

* Some facts about vector functions were given in Section 5.1.6 of [4]. 


** The jvector r is in general in a p-dimensional Euclidean space E? and is 
therefore defined by the coordinates r,, ra, . . «> Tp- 


396 Fundamentals of Mathemetica! Analusis 


function of a single scalar variable is in general a curve. The locus 
of s vector function of two variables is in general a surface. 

12.4.2. The limiting value of a vector function. Continuity. In 
close analogy with ordinary functions the concepts of limiting value 
and continuity can be introduced for vector functions. 

Asa preliminary we introduce the concepts of a convergent sequence 
and of limit of a sequence of vectors. 

A sequence {a,)} is said to converge to a@ vector a if given any © > 0 
we can find N such that for n > N* 

Ja, ~al<e. 

The vector a is the limit of {ap}. 


In symbols 
lim a, =a. 
TR OO 
Remark. If {@yn, @any «+ +1 @pn} ANd {@y, dq... -. Ap} are Tespec- 
{ively the coordinates of a, and a, then the convergence of {ay} to @ 
implies the convergence of the number sequences {ayn}, {Gon}. -- + 
«+ {@pn} to the numbers aj, ag, .- +, Ap, respectively. Also note 
that the convergence of the number sequence Lo a, a2, dp, respectively, 
implies the convergence of a sequence {a,} of vectors with coordinates 
{Qiny Qons - - +) Apa} to a vector a with coordinates {a), a2, .. «. ap). 
The remark follows from the following obvious inequalities* *: 


| din — Ox) <a, —@| < Jay, — | [en — ay | + see 
cee 1 apn — Gp |. 


Consider a vector function » = r(A/) defined on a set {AJ} of 
points of an m-dimensional Euclidean space and a point A, possibly 
not in {A} but having the property that in any neighbourhood of the 
point there is at Jeast one point of {.1/} different from A. 

Definition 1. A vector b is said to be the limiting value of a@ vector 
function r (Af) at a point A (or the limit of r (.V/) as Sf + A) if for 
any sequence M,, Ms, ..., My, ... of points of {MM} converging to A 
whose elements M,, are different from A*** (\M,5¢A) the corresponding 
sequence r (Ay), r (Mls), 26 CMa), . - - of the values of r (21) cor- 
verges to 0. 

In symbols 


lim r(M)=b or lim r(uy, us, 0.2, Un) =, 
Moa Uy=ay 


where @1) Qs. ++ +: Gq are the coordinates of A. 


* The absolute value | a | of a vector a with cucrdinates {ay, ag, ~~. ay) iF 


a number VYa+ra+...+ ae 

e* The vector a, — a hascoordinates (ey, — Gy. Yay me Uae eo oy ayn — 4y}- 
e¢s This requirement is accounted for, in particular, by the fact that a function 

+ (3D may or may not be defined at A. 


Ch, 12. Fundamentals of the Theory of Curves and Surfaces 397 


We shall not give any definition of the limiting value of a vector 
function in terms of “e — &”’, neither shall we give any for the case 
where JZ tends to infinity. They can be formulated in full analogy 
with the corresponding definitions for scalar functions. 

Let a point A be in the domain of a vector function r = r (AJ) 
and let any neighbourhood of it contain points of the domain differ- 
ent from A. 

Definition 2. A vector function r = r (AM) is said to be continuous 
at a point A if the limiting value of the function at A exists and is 
equal to a particular value r (A). 

A vector function r = r (A) is said to be continuous on a set {J} 
if it is continuous at each point of that set. 

12.4.3. The derivative of a vector function. In Section 5.4 of [1] 
we discussed the derivative of a vector function of a single scalar 
variable. For convenience we shall formulate that notion once again. 





Fig. 12.4 


Let r =r (u) be a vector function of a scalar variable u. Fix a 
value u of the variable and assign to the variable wu an arbitrary 
increment Au =< 0 such that uw -+ Au is in the domain of the function. 
Consider a vector 

Ar =r (u + Au) ~—r (u). 

In Fig. 12.4 it coincides with the vector 47P. On multiplying Ar by 
a number 1/Auw we obtain a new vector 

Ar 1 

Eo AE (u-Au)—r (u)] (12.1) 
collinear with the old one. The vector (12.1) represents the average 
rate of change of the vector function on the interval [u, u -+ Aw]. 

The derivative of a vector function r = r (u) at a given point u is 
the limit of the difference quotient (12.1) as Au —-0 (provided the limit 
exists). 

It is designated r’(u) or =. 

Geometric considerations* make it clear that the derivative of a 

vector function r = 7 (uw) is a vector tangent to the locus of that 


* They are supported by the statement in Section 12.2.2, 
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function. We show the relation of the derivative of r = rv) to the 
derivatives of ils coordinates. For simplicity, consider the case where 
the values 7 (w) of a vector function are vectors of a three-dimensional 
space. Let {x (u), y (u), 2 (u)} be the coordinates of the vector function 
r (u). Obviously, the coordinates of the difference quotient (12.1) are 
equal to 


x(u-- Awj—szr (u) wus Aujm—au(u) 2 (-. Auj—s (u} 
Au % Au 7 Au : 


According to the remark of Section 12.4.2 the coordinates of r' (u) 
are equal to the derivatives 2’ (u), y’ (wu), 3’ (1) of the coordinates of 
r(u). Computing the derivative of the vector function therefore 
reduces to computing the derivatives 
of its coordinates. 

Remark 1. The vector function » (1) 
can he regarded as the law of motion 
of a particle along the locus ZL of the 
function, if the variable w is considered 
as time. The derivative x’ (uv) is there- 
fore equal to the rate of motion of the 
particle along the curve ZL. 

Remark 2. Note jthat the rules of 
differentiation of the various products 
of vector functions (the scalar, thefvec- 
tor, and the triple one) are identical 
with those for differentiation of the products of ordinary functions, 
This follows from the fact that the coordinates of the derivative of 
a vector function are equa] to the derivatives of the coordinates of 
the function itself and from expressing those products in terms of 
the coordinates of the factors. 

Tere are the rules of differentiation of vector function products: 


{r (wu) § (u)}' =r! (u) s (u) er (u) s" (u). 

{Ir (2) s (u)}} = Er! (u) 8 (te) + Er (ue) 8° (x), 

{r (u) s (u) t (u)}Y =r’ (u) s (u) t (u) +r (u) 8’ (u) fu) + 
-or(u)s(u) t' (u). 


We now proceed to discuss differentiation of vector functions of 
several scajar variables. Since in what follows we shall use vector 
functions of two scalar variables u and v, we shalJ confine ourselves 
to this case. 

Let a vector function r = r (u,v) be given in some neighbourhood 
G of a point A/p (ta, Up) (Fig. 12.2). Consider in the plane (u. r) some 
direction defined by the unit vector @ with coordinates cos a, sin a. 
Draw through WV, an axis 7 whose direction coincides with that of a, 





Fig. 12.2 
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take on Z points M (u, v) and denote by J the magnitude of a directed’ 
segment J7,/7 of l. The coordinates (u, v) of a point M are given by 


u=Up+loosa, v=va+lsina. 


On the axis 1 the function r = r (u, v) is obviously a vector function 
of asingle variable 1. If that function has at the point 1 = 0 a derivative 
with respect to the variable 1, then that derivative is said to be the deri- 
vative of r=r(u, v) at the point My (Uo, Vo) with respect to the 


direction of 2 and designated + : 


Remark 3. If the direction of ? coincides with that of the 
coordinate axis u(axis v) (in Fig. 12.2 these directions are indi- 





cated by the broken lines), then the corresponding directional 
derivative is said to be the partial derivative of r(u, v) and 
designated a Or ry (+ or ry} . if as is defined al every point 
of some neighbourhood of Jf (u, v), then it is a vector function 
in that neighbourhood. It may in its turn have a partial deri- 
vative, with respect to the variable u, for instance. It is natural 
to call that partial deriyalive the second partial derivative with 


respect to wu and designate it ous (or ryy). Other partial deriva- 


tives of various orders can be similarly defined. 

The geometrical meaning of the directional derivative will be 
clear from the following reasoning. The locus of r=ryu, v) is 
in general a surface S (Fig. 12.3). When a point Jf (u, v) moves 
along 1, the end point P of r(u, v) describes on S a curve L 


which may be regarded as the locus of a vector function of 

a single variable 1. The derivative ss with respect to the direc- 

tion of 2 is therefore the vector tangent to LZ at the point Pp. 
If the direction of 2 coincides with that of the coordinate 


axis u, then as a point J% moves along the corresponding 
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axis passing jthrough ., the end point of the vector r(u, rv) 
describes on SS a curve called a@ coordinate curve wit is designat- 


ed by the broken line in Fig. 12.3). Thus a is the vector tan- 


: "1 ° . ° wr. 
gent to the coordinate curve u. The partial derivative — is the 


vector tangent to the coordinate curve v. 

12.1.4. Differentiability of a vector function. Zhe increment for 
total increment) of a vector function r = r (u,v) ata point VW (u,v) 
{corresponding to the increments Au and Av of the independent 
variables) is the following expression: 


Arz=r (u + Au, v + Av) bee r(u, v). 


A vector function r = r (u, v) is said to be differentiable at a point 
M (u, v) if its total increment at that point may be represented as 


Ar =a Au+t+b Av+a Au + Bf Av, (12.2) 


where a and b are some vectors independent of Au and Av and « and fs 
-are infinitesimal vector functions as Au ~~ 0 and Av -0* equal to 
zero when Au = Av = 0**, 

Remark 1. [fr=r(u,v) is 
differentiable at a point Af (u, v), 
then obviously aand b are equal to 
—— and = at the given point, re 
spectively. 

Remark 2. Let r=r(u, v) bea 
vector function differentiable at a 
point AT {u, v) and let 2 be some 
"Fig. 12.4 axis passing through AT in the plane 

(u, v)and making an angle @ with 
the axis u. Then the derivative a with respect to the direction 
of Z exists and can be found from the formula 





or an or 
ew St ee LH sj 9 ¢. 
7 a cos a+ aa SsInG. (12.3) 


Indeed, for the direction of 2 we have Au-=lcosa, Au-~=Isin2 
(Fig. 12.4). Substituting these values of Au and Av in relation 


(12.2) and using the relation = lim a we see that formula 
1-0 


(12.3) is valid. 


* A vector function « (Au, Av) is said to be infinitesimal if its lirnit os 
Au-- (and Av —0 equals zero (the zero vector). 

** We give no definition of differentiability of a vector function of a single 
sealar variable. [It ean be formulated in close analogy with the carresponding 
definition for scalar functions of a single variable. 
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Remark 3. We have seen that in the case where the function 
r=r(u, v) is differentiable formula (12.3) is true. It follows 


from this formula that all vectors 2“ are in the plane of the 


al 
vectors ~>— and =, It is natural to call the plane passing 


through the point of the locus of r(u, v) corresponding to a 
point Af (uw, v), and parallel to a and a the tangential plane 
to a surface § which is a locus. In Fig. 12.3 the plane x is 
the tangential plane to the surface S at Pp. 

12.1.5. The Taylor formula for vector functions. The Taylor ex- 
pansion formula for a function r = r (u, v) with centre at a point 
AM (u, v) and with remainder in the Peano form is as follows: 


r(u--Au, v+Av)=r(u, v) + 2 Ay tO) Ay + 


1 /d*r(u, v) d°r (u, v) 
+7 ( Gu? Au?2 du dv Audv + 


ar (u, v) 4 a r(u, v) 
+ Av?) to po (GR au + 
o'r (u, v) 


+n saatg, Aut iAvt... + Soe Av* | +R,(Au, Av), (42.4) 


where the remainder &, (Au, Av) is a vector whose order of small- 
ness is higher than p" (p = VV Au? + Av*)*. 

The validity of formula (12.4) can be shown by representing each 
of the coordinates of the vector r (uw, v) by the Taylor formula with 
remainder in the Peano form and then writing the expression for 
r(u-+ Au, v + Av) with the aid of an expansion with respect to the 
basis vectors (the coefficients of the expansion wil] be the coordinates 
of that vector). 

12.1.6. Integrals of vector functions. We have already noted that 
a vector function is defined by its coordinates which are scalar 
functions. This allows the operation of integration to be carried over 
to the case of vector functions. 

Let a vector function r (uv) be given, for instance, on a closed 
interval [a, b] and let its coordinates r, (u), re (¥), 73 (¥) be functions 
integrable on [a, b]. If e,, e,, eg are basis vectors, then it is natural 
to set by definition 


b b b 6 


j r(u) dusey | ry (u) du-be, i rs (u) dub ey j rs (u) du. 


a a a a 


* The order of smallness of a vector is defined to be the order of smallness of 
its absolute value. 


26-01684 
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A smooth curve L without singular points has the tangent at every 
point P. 

We prove that the tangent is the straight line PQ passing through 
the point P and parallel to the vector r’ (t) (recall that r’ (t) 54 0). 


Indeed, the vector Seis parallel to the chord PM (see Fig. 12.5) 


and tends to r’ (¢) as At +0. It follows that the angle between the 
straight line P17 and the straight line PQ tends to zero as M > Py 
Therefore the straight line PQ is the tan- 
gent to the curve L. Thus the statement is 
proved. 

We derive a vector equation of the tan- 
gont to acurve L ata point P. Let R be the 
radius vector of a variable point Q on the 
tangent at P. The vector PQ ='!R—r (t) 
is collinear with r’ (t) and _ therefore 
R—r (t) = ur’ (t). From this we obtain 
the desired equation 


R=r(t) + ur’ (2) (12.5) 


where u is the parameter and / is the fixed 
parameter value on Z defining P. 

12.2.3. The osculating plane of a curve. Let PQ be the tangent 
{o the curve Z at P (Fig. 42.6). Through PQ and the point M of L 
draw a plane POM. The plane x to which PQM tends* as M + P 
is called the osculating plane to the curve L at P. 

The following statement is true. 

A regular (at least twice differentiable) curve L without singular 
points has the osculating plane at every point at which r' (t) and r” (t} 
are not collinear. 

We prove that an osculating plane is the plane x passing through 


the tangent PQ and parallel to r” (t). Obviously the vector 





Fig, 12.6 


n = {r’ (t) r” (t)) (12.6) 
is the normal vector to the plane x and the vector 
m= pe fr (t) Ar}, Ar=r(t-+At)—r (t) (12.7) 


(see F'ig. 12.6) is the normal vector to the plane PQM. Since L is 
twice differentiable, by the Taylor formula 


Arar’ (i) At-+—r" (t) A@ +a-AP, (12.8) 


—_— 


* We shall say that the plane PQM tends to the plane = as Mf > Plifithe 
angle between them tends to ‘zero. 
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where @ is an infinitesimal vector function as At — 0. From formulas 
(12.6) to (12.8) it follows that 


m= lr’ (i) r"’ (1+ 2 r' () a] =n + B, (12.9) 


where f = 2 [r’ (t) a] is an infinitesimal vector function as At ->0. 
It follows from relation (12.9) that the vector m tends to mas Mf + P 
and consequently so does the angle g between the planes POA and a. 
Therefore the plane a is the osculating plane to the curve at P. 
Thus the statement is proved. 

We derive a vector equation of an osculating plane. Let 2 he 
the radius vector of a variable point S of that plane. The vectors 
PS = R—r(?), r’ (t), and r” (t) are parallel to the osculating 
plane and therefore R —r (t) = ur’ (ft) + ur" (t). From this wo 
obtain the desired equation of an osculating plane 


R=r (t) + ur’ (t) + vr’ (t), (42.10) 


where w and v are the independont variables of the function 2 and t 
is the fixed parameter value on Z corresponding to the point P. 

We obtain the equation of an osculating plane in another form. 
Since R —r (t), r’ (8), r” (f) are coplanar, F satisfies tho following 
equation: 


(R —r (t))r’ (t) rr’ (t) = 0. (12.44) 


If X, Y, Z are the coordinates of R (the coordinates of the variable 
point S of the plane 2) and z (t), y (t), s(t) are the coordinates of 
r (t), then in coordinate form equation (12.11) becomes 
X—z(t) Y—y(t) Z2—=< (t) 
z(t) oy’ (tt) s(t) = 0. (42.12) 
z(t) y(t) a" (it) 
Equation (12.12) is obviously the equation of an osculating plane. 
Remark. We have defined the osculating plane geomotrically by 
means of proceeding to the limit, and therefore if it oxists it is 
unique. From this and from the statement proved here it follows that 
if at a given point a of a curve thero is an osculating plane, then for 
any parametrization of the curve r” (t) is parallel to that plane. If 
the parameter f is considered as time, then r” (ft) is the acceleration 
vector as the point moves along the curve Z according to the law 
r (t). Thus with any method of motion along a curve, the accoleration 
vector at a given point is in the osculating plane of the curve at that 
point. Therefore the osculating plane is also called the plane of acce- 
leration. 
A straight line passing through a point P of Land perpendicular to 
the tangent at that point is called @ normal. A normal in the osculat- 
ing plane is called the principal normal of the curve and a normal 
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perpendicular to the osculating plane is the binormal to the curve. 
Derivation of equations of these straight lines will be left to the 
reader. 

12.2.4. The curvature of a curve. Let P be a point of a regular 
curve Z without singular points and let M7 bea 
point of LZ different from P. Denote by 9 the 
angle between the tangents at P and MM and by 
1 the length of an arc PM™ (Fig. 12.7). 

The curvature k, of L at P is the limit of the 
ratio g/d as 1 +O (i.e. as M -> P). 

The following statement is true. 

A regular (twice differentiable) curve L without 
singular points has a well-defined curvature k, at 
each point. 

We proceed to prove the statement. Let P and 
M correspond to parameter values ¢ and ¢ + At, Fig. 12.7 
respectively. 

Evaluate sin m and J. Since LZ is regular, r’ (t) =< 0 at any point of 
£ and therefore 


Ltr’ r' (t.A0) | (12.18) 





OEE Os 
t+At 
= \ [r? (x) | d= |r? (vc) | At= |r’ (t) | At+ dAt (12.14) 


t 


where 5 --0 as At 0. 

Note that in the transformations of the expression for J we used 
the mean value formula for the integral and the continuity of the 
function r’ (2). 

We transform the expression (12.43) for sing. By the Taylor 
formula 


r(t+At)h=r'(t) +r’ (t) At+aAt, a+0 as At+0. 
Using this formula makes the expression (12.13) for sin pm take the 
following form: 
Lin’ ®r” 1 1+8 

rote Ah tz-49) 


where B +0 and y 0 as At >0 
Turning to formulas (42.14) and (12. 15) and using, with + 0, 
the identity 


sin Q= 








* Since ZL is regular, any arc PM of L is rectifiable, 
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pla 


r is equal to zero ) we get 


(with q=0, the ratio 


@ PM’ (yr (ON ; 
To aag Fr OPHR ee 





where B and p tend to zero as At->0. Since p-+0 as At 0, 


ee ~ 1 as At +0. Therefore it follows from (12.46) that as 


At +0, i. as AY + P, the limit > exists and equals 


q 
tir’ or" (On i , 
ror Thus the statement is proved. 


So under the hypotheses of the statement the curvature /, oxists 
and can be found from the formula 


p= Ue Oro 
eS ara 





(12.17) 


Remark. If the arc Jongth J is chosen on a curvo as a parameter, so 
that r =r (l), then [r’ (2) | = 1 and r’ (?) is orthogonal to r’ (/)*. 
In this case obviously formula (12.17) takes the following form: 


ky = |r" (2) |. (42.48) 


12.2.5. The torsion of a curve. Let P be a point of a regular curvo L 
without singular points and let AZ be a point of L different from P. 
Denote by 9 the angle betweon the osculating points at P and A 
and by J the length of an arc PV. 

The absolute torsion |}. | of tho curve LZ at P is the jimit of the 
ratio p/Z as 1 +0 (i.e. as AY + P). 

The following statement is true. 

A regular (three times differentiable) curve L without singular points 
has a well-defined absolute torsion at every point where the curvature is 
different from zero. 

We proceed to prove the statement. 

Let P and + correspond to paramoter values ¢ and f + At respec- 
tieoly. The normals to the osculating planes at P and Jf are defined 
hy the vectors [r'r"] p and [r’r"};-**. By the Taylor formula, consid- 


——— 
* If the are length is a parameter, then by virtue of the arbftrariness of ! 
ILAl 


and Al it follows from the formula Al = ( Tr’ (t) | dv that Jr’ (i) | = fat 


“ 


1 
any point of the curve. Differentiating r’? (2) = 1 we get 2r’ (1) r* (1) = 0, i.e. 
r” (). is orthogonal to r’ (I 


*¢ The expressions [r'r"]p and [r'r"],- mean that the vector product [rr 
is computed at points P and Af respectively. 
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ering that [r"r"] = 0, we got 
Ir'r"} s¢ = [r'r"]p - (Ir’r"}) Pp At+aAt= 
= [rr] p -} [rr] p Al + a Al, (42.19) 
where a +0 as At 0. 
To compute the limit of q// as 7 0 we shall need the value of the 
sine of the angle g between tho normals to the osculating planes at P 
and WW. To this end we find the absolute valuo of the vector product 


of [r’r”}p and [r'r”},, and the product of the absolute values of these 
vectors. Using (12.19) yields 


(fr’r "Jp 2’ ye) = [277 Ip ([e'r" | p+ [r’r"] p Ait 4+ @Ad)]. 
From this, employing the distributive property of a vector product 


and the well-known formula [a [bc]] = b (ac) —c¢ (ab) for a double 
vector product, we find 


[[r'r"] p [r'r"] ar) = rp (r'r’r")p At +- BAt, 
where Bf = [[r’r"] p a], and therefore B 0 as At +0. From the last 
expression for [[r’r"] p (r’r7}4,] we obtain the following formula: 
Hlr’"]p [7'r" Jar} = [rp] [(r'e"r")p] At-+ At, (12.20) 


where y +0 as At -+0. 
Similarly we obtain also the formula 


Hir'e" |p] dire" acl = [rr b+ At, (12.21) 


where 0 as At +0. 

Using formulas (12.20) and (42.21) we obtain the required expres- 
sion for sin 9: 
Ur’ e'r’r")t -y) At 


es a {r’r’}Pa-pat 





Note that in this expression the values for the derivatives of the 
vector function r (t) are computed at P. 
Turning to the expression (12.14) for Z, using the just obtained 





formula for sing and the well-known limit tae — 1 as 
@ — 0 we see that the limit + as 1-+0Q exists and equals 


Ler") | 

[r'r"}e e 

So under the hypotheses of the statement the absolute torsion 
{ft. | exists and can be found from the formula 


[ip| = (12.22) 


[r’r"}? 
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We define the torsion i, of a curve using the equation 


did 
n= +-Eoe. (12.23) 


We prove that /:, is independent of the choice of parametrization of a 
curve and is therefore a well-defined geometrical characteristic of a given 
curve*, : 

We proceed to another parametrization of a curve, with the aid of 
the parameter t. 

Denoting differentiation with respect to t by a dot we obtain the 
following formulas by the indirect differentiation rule: 


ri=rt’ 
r"=rt’*+{terms linearly expressible in terms of r}, 


ese ¢ oe 
r’= rt'3+{terms linearly expressible in terms of r and r}. 
From these formulas follow the relations 


rre'rya(rr pr ye® [irl ries. 
9 


Thus 
RT a (rrr) 
a Gil Dares 


We have shown that k, is independent of the choice of parametriza- 
tion of a curve. 

12.2.6. Frenet’s formulas, Natural equations of a curve. In Sec- 
tion 12.2.3 we have introduced the concepts of normal and binormal 
of a curve. These together with the tangent are the edges of a tri- 
hedral angle called a@ natural trihedron. Let the arc Iength be a para- 
meter Jon a curve L. Thenr’ (1) = tis the tangent unit vector to L. 
Choose the unit vector n of the principal normal to be collinear with 
r* (1)** and take as the binormal unit vector 


b = [tnl. (12.24) 


Thus ft, 2, & form a right-handed triple of vectors, i.c. (tab) > 0. 
They are functions of the arc length. We find the expansions of the 
derivatives 7?’, n’, b' of these functions with respect to t, n, and b. 
Since t =r’ (9, we have t' =r" (1). Therefore the vector t’ is 
collinear with n: 

v= an. 

* The absolute value | k,| is definrd geometrically. Hence parametriza- 
: 2 . F (r'r’r”) 
tion may influence only the sign of the expression apr 


** According to the remark of Section 12.2.4 the vector r’ (1) is orthogonal to t 
and is in the osculating plane of the curve. 
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According to the remark of Section 12.2.4 a=hk, (a= |v |= 
=r’ (1) | = *;) and therefore 
= kyr. (42.25) 


We now turn to the vector 8. Since it is a unit vector, 0’ is orthogonal 
to ¥&. We prove that 8’ is orthogonal to ¢ as well. Differentiating the: 


p’ 







Osculating 
&  oplane 
aaa 
Rotation of binormat, fy w 
with 7 Increasing : 


Rotation of principat 
normat, with [ increasing 


Fig. 12.8 


med (bt) = 0 we get (6’t) + (bt’) = 0. Since by (12. 25) (ov) = 
k, (bn) = 0, we have (6’t) = 0 and this means that 6’ is orthogo- 
nal to t. It follows from the above reasoning that 0’ is collinear 
with n, i.e, 
b' = Br. (12.26). 


We prove that B= —k,. Let o be the angle between the oscu- 
lating planes of a curve at the points corresponding to parame- 
ter values 2 and l-+-Al. Clearly the angle between O(2) and 
b(l+ Al) is also equal to g, since b is ae to the oscu- 


lating plane. Considering therefore that a =k, we get 


tse, | BUEAD—DD {_;. 
[b’| =lim aoe = him any, 


Al=+0 Al-0 

Consequently, since | B | = | 0’ |, we have the relation [ B | = [ke |. 
Let 6’ and m have the same direction. It follows from formula (12.26) 
that in this case B = |b’ |, ie. B > O. It is clear that in this case 


r' (0), a (1), and r’” (2) form a triple opposite in sense to the iriple 
t, n, 6 (Fig. 12.8) and therefore (r’r’r’”) <0, ie. kg <0. Since- 
B>0 and |B | = |, |, we have B = —ky. In the case where 0’ 
and nm are opposite in direction, a similar reasoning readily shows 
that 8 <0 and k, > 0. Since | B | = |, |, in this case, too B = —kp. 
When f = 0, the equation B = —k, is obvious. So we have proved 
that 


B = —ke. (12.27). 
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From formulas (12.26) and (42.27) follows the required expression 
for b’ 


b' == —hn. (42.28) 
We now find the expression for n’. Using the rule of vector product 
difierentiation and formulas (42.25) and (412.25) we get 

n' = [bt)’ = [b't] + (bt) = —k, [nt] + hy (bn) = —hyt + kb. 


Tabulating formulas (12.25), (42.28) and the expression for 2’ just 
obtained we get the following formulas called Frenet’s formulas* 


t' = yn, 
ni! = —Iyf + hgh, (12.29) 
= —hpn. 


They are also called the basic formulas of the theory of curves. 

It follows from Fronot’s formulas that if the curvatures /, and hk, 
of a curve Z are known, it is possible to find the derivatives of the 
vector functions 7, 2, and B (i.e. the rates of chango of these functions). 
This naturally suggests that curvature and torsion define a curve L, 
which is really the case. Namely, the following statement is true. 

Let ky, (l) and ky (1) be any differentiable functions, with k, (l) > 0. 
Then there is a curve unique up to a position in space for which ty (1) 
and Jt, (l) are curvature and torsion respectively. 

We shall not prove this statement. Note merely that its proof 
relics on the theorem of the existence and uniqueness of the solution 
of a system of ordinary differential equations. 

Since according to the above statement the curvature fy, (/) and 
torsion }, (1) completely define a curve, the system of equations 


ky = hi (2), ley = he (2) 


is usually called the natural (intrinsic) equations of a curve. 


12.3. SOME FACTS FROM THE THEORY OF SURFACES 


In Chapter 5 we have learned a number of important facts about 
surfaces: we were introduced to the concept of surface, to tho con- 
cept of regular and smooth surface without singular points, to the 
concepts of tangential plane and of normal to a surface. Here wo 
shall discuss a number of other important properties of regular sur- 
faces. 

12.3.1. The first quadratic form of a surface. Mensurations on 
a surface. Let ® be a regular surface without singular points and 
Jet r (wu, v) be a radius vector of that surface. Then, as is known, 
Irurp}] sO. 


* J.F. Frenet (1816-1900) is a French mathematician 
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The first quadratic form I of a surface @ is the expression 
J = dr’. (12.30) 


The term “quadratic form” is associated with the fact that the expres- 
sion 


I=dri=(r,du-+r, dv)? =r}, du? + 2ryr, du dv+r§ dv? 


isjthe quadratic form of the differentials du and dv. 

The first quadratic form is a positive definite form: it goes to 0 only 
if du = dv = 0 and is definite for the other values of du and dv. 
Indeed, if dr? = 0, then dr =r, du +r, dv = 0. Therefore, if du 
and dv do not vanish together, then from r, du +r, dv = 0 it 
follows that r, and r, are collinear, i.e. [r,7,] = 0, and this is 
impossible since under the hypothesis [r,r,] ~ 0. 

For the coefficients of the first quadratic form the following notation 
is used: 


r=E, ryr,=F, ri=G. (12.34) 


In this notation the expression (12.30) for the first quadratic form 
becomes 


I = dr? = EF du® + 2F du dv + G dv’. (12.32) 


So on a regular surface © given by a radius vector r = r (u, v) the 
first quadratic form I is defined by relation (12.32). The coefficients of I 
can be calculated from formula (42.31). 

Using the first quadratic form it is possible to make measurements on 
a surface: to calculate are lengths of curves and angles between curves 
and to measure areas of domains. 

Let L be a regular curve on ® defined by the parametric equations* 


=u(l), v=v(i), batch, (12.33) 


u (t) and v (t) being differentiable functions with continuous deriva- 
tives. 





* It is clear that representation of u and v as functions (12.33) of some para- 
meter ¢ defines on the surface a curve given by the vector function r (u (t), v (#)). 
The question whether any smooth curve L on ® can be given by parametric 
equations of the form (12.33) can get an affirmative answer, for instance, as 
follows. Let = (t), y (t), z (t) be parametric equations of L. Then u and v as func- 
tions of ¢ can be determined from the equations z (t) = x (u, v), y (t) = y (u, »); 
z(t) =z (u, v). A solution of the form (412.33) is guaranteed by the condition 


{ruvol = 0 from which it follows, for example, that 7u 70 | 40, The last 


condition ensures the solvability of the system z(t) = x (i, Wy y (t) = y (u, v) 
for w and v 
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It is known that the length Z of the arc of Z defined, by the radius 
vector r =r (uw {t), v (t)) can be found from the formula 


t 
[= ( (t)| dt (42.34) 
ig 
(see formula (44.24) in [4]). 
Since |r’ (t) | dt = |r’ (u (t), v (t)) |dt = | dr (u, v) | from for- 
mula (12.34) we get 


t 
l= j Jr'|dt= j ldr (u, v)|= j Var={\ VT (12.35) 

to L L L 
(the Jast three integrals in (42.35) aro line integrals of the first kind). 
So if we know the first quadratic form we can use (42.35) to calculate 
Jengths. 

We now proceed to measurements of angles on a surface. 

Let a surface @ be given by a vector function r = r (u, v). 

A direction du : dv at a point P on @ is defined as the direction of 
the vector dr =r, du+-r, du at that point*. 

Consider at P two directions, du: dv and 6u: 6v. The angle » 
between them is determined from the analytic-geometry formula 
for the cosine of the angle m between vectors dr =r, du +r, dv 
and é6r = ry, du + r, dv: 

(dr-6r) 

Vary oF 
From this formula we obtain the following expression for cos p 
if we take into account reJations (12.34): 


E dubu--F (dubv-+- dvgu) 4+-G dv &v 
V E dut-+-2F du dv+-Gde? V Bou2-+-2l 6uby+- Gov? 


cos p= 


cos p= 


The angle between curves L, and L, on @ intersecting in P can be 
defined as the angle between the directions of the tangents to Ly 
and ZL, at P. Note that if a curve on a surface is defined by the para- 
metric equations u =u (ft), v = v(t), then the direction du : dv 
at a point of that curve is defined by the vector 

dr=r,du-r, dv=(rgu’ +p’) dt. 

So if we know the first quadratic form}we can use (12.36) to cal- 
culate the angles between directions on a surface. 

The question of measuring the areas on a surface was considered 
in detail in Chapter 5. 

Recall that if a domain JJ on a surface is defined by parameters u 
and v in their domain Q, then the area g of IM can he calculated from 


* Obviously, this vector is in the tangential plane ‘at'P. 
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the-formula 
ee j j V EG—F* du dv 
2 


(see formula (5.18)). 

Thus, if we know the first quadratic form we can measure the areas 
of domains on a surface. 

All the facts that can be obtained by measurements on a surface 
using the first quadratic form relate to the so-called intrinsic geometry 
of surfaces. : 

Two different surfaces may have the same intrinsic geometry. The 
simplest example of such surfaces is the plane and parabolic cylin- 
der, Note that surfaces having the same intrinsic geometry are called 
isometric. 

12.3.2, The second quadratic form of a surface. Let @ be a regular 
surface defined by a radius vector r = r (u, v) and let x (u, v) be 
the normal unit vector to that surface given by 


(ruryl oo: {rury] * 
Wfrurol) YEG—F2 * (12.37) 
The second quadratic form II of a surface is the expression 


r= 


I] = —dr dn. (12.38) 
Since dr-n = 0**, d (dr-n) =0, i.e. dr-n = —drdn, and therefore 
the second quadratic form can also be given by 

I = @r-n, (42.39) 


Since @r = r,,,, du? + 2r,, du dv +7rp, dv’, according to (12.39) 
the second quadratic form may be written as 

Il = (ryym) du? + 2 (rym) du dv + (rppi) dv, (42.40) 

the coefficients of the second form the following notation is 
used: 

Tyyh = L, Tyyh = M, Toph = Nw (12.41) 


Applying to the expression (12.37) for 2 and using (12.41) we obtain 
the following formulas for the coefficients of II: 











L= a 37, M= Sea “7. N= Toe be (12.42) 


12.3.3. Classification of points of a regular surface. We discuss 
deviation of a surface from the tangential plane at a given point. 





* Since | [rurol |=Vr2r2—(rurs)*, according to formulas (12.34) 


{{rurol |= V EG— F2. , 
** The vector dr is in the tangential plane to the surface and therefore dr-n =0. 
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Let @ be a regular (twice differentiable) surface, lot r =r (u, v) 
be a radius vector defining it, let # (uz, v) be the normal unit vector, 
Iet P (u, v) he a fixed point of the surface, let n,, be the vector r (u, v) 
at P*, and let AY be a point of the surface corresponding to parameter 
values u + Au, v + Av (Fig. 12.9). 

Let 4 be the foot of the perpendicular dropped from Af to the 
tangential plane x at P and let # be a quantity whose absolute value 





Fig. 12.9 


is equal to tho distance from Af to a, hk having a positive sign if 


the directions of the vectors Nf and np coincide and a neyativo 
sign otherwise. Obviously 


h = dr-np, (12.43) 


where Ar =r (u + Au, v + Av) — r (u, v) = PM, Since uv and v 
are independent variables, we may assume Au = du, Av = dv, and 
therefore using the Taylor formula (see formula (12.4)) we get 


Ar=(dr)p+ 4 (Cr)p+ Ry (12.44) 


In this relation the differentials are calculated at P, and Ry isa vector 
of an order of o (p?), where p = )/du® +- du®. From formulas (42.43) 
and (412.44) we obtain for h the following expression: 


h=Sdrptp+Rytp (12.45) 


Since d*rp-np is the second quadratic form IJ p calculated at P 
and Rentp = o (p*), relation (12.45) may be rewritten as 


h= 4 Mp+0(p%). (12.46) 


Turning to formula (42.46) it is possible to conjecture that h is 
mainly influenced by the first term, 4 IJ p, and therefore the spatial 


* In what follows a letter P at the bottom of a vector will indicate that it Is 
taken at a point P. 
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structure of the surface near a regular point is defined by the second 
quadratic form at that point. 

The following arguments support this conjecture. 

4°. Ilp is of fixed sign (LN — M? > 0). 

In this case* 


\Ip]2>Ap*, A>0. 


From this and from relation (12.46) it follows that k maintains sign 
for every sufficiently small value of p and therefore in a neighbour- 
hood of a point P the surface is on one side 


of the tangential plane mp at that point 

(Fig. 12.40). 
Such a point on a surface is called elliptical. + 
The sphere, ellipsoid, elliptical paraboloid i iH 


are examples of surfaces each point of which 2 
is elliptical. 

2°. Ip is alternating (LN — M? <0). In 
this case we can find two different directions, 
du : dv and §u : dv, at a point P ona surface 
such that for the values of the differentials of the variables u and v 
corresponding to those directions I] p vanishes while all the other 
directions are divided by those two into two classes. For the differen- 


Fig. 12.10 





Fig. 42.44 


tials du and dv the ratio du : du of which defines the direction of one 
of the two classes the second form II pis positive, and for the ratios 
du : dv defining the directions of the other class it is negative. There- 
fore the surface near a point P is on cither side of the tangential plane 
Hp at that point (Fig. 12.41). 

Such a point on a surface is called hyperbolic. 

Each point of a one-shected hyperboloid and of a hyperbolic para- 
boloid is hyperbolic. 

3°. I], is quasi of fixed sign (LN — M* = Q), In this case we can 
find a direction du : dv at a point P on a surface such that for the 


* It is possible, for instance, to show the validity of the inequality | IT p | > 
> Ap* as follows. We have | Jip] = | 0 du? + 24f dudu+ N de? | = 
={ cos? a+ 24 cosasina + N sin? a { p*, where cosa = du/p, sing = 
== dlp. Since I p is of fixed sign, the expression | L cos? @ + 24 cos @ sin a-t- 
+N sin? a | has a positive minimum A, ic. | Ip] > Ap* 
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values of the differentials du and du defining that direction the second 
form vanishes. For all the other values of the differentials II p main- 
tains sign*® (Fig. 12.42). 

Such a point P on a surface is called parabolic. 

Bach point of a cylinder is parabolic. 

4°. I1p is equal to zero at a point P(L = Af = N = 0). Such on 
point P is called a point of flattening. Figure 12.43 depicts a surface 
with a point of flattening. 

Any point of a plane is a point of flattening. A point with coordi- 
nates (0, 0, 0) on a surface given by the equation s = 2*-+ y may 
serve as an example of an isolated point of flattening. 





Fig. 42.13 Fig. 12.44 


Note that if all the points of a surface are points of fattening that 
surface is a plane. 

12.3.4. The curvature of a curve on a surface. Let @ be a regular 
surface given by a vector function r = r (u, v), let nm be the normal 
unit vector to 7), and let J be a regular curve on @ with a direction 
du :dv ata point P (u, v). 

Choose the length 2 as the parameter on LZ so that r = r (u (2), 
v (l)) = r (1) along ZL. In Section 12.2.6 wo have established that 
r’” (1) is directed along the principal normal n, to Z at P and that 
the absolute value of that vector is equal to the curvature k of Lat P. 

Therefore 


r’'n =k cos 9p, (12.47) 
where sp is the angle between the principal normal ny, to a curve J 


and the normal n to a surface (Fig. 12.14). By the indirect differen- 
tiation rule 


YM’ (l= ry try, pu’! +r,vitryu’ -- rv”. 


Since n is orthogonal to r, and r,, substituting the obtained expres- 
sion for r” (2) on the left-hand side of (12.47) and taking into account 





* In this case the second form may be represented as the square of some Iincar 
form of differentials du and dr, 
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formulas (12.41) we get 
r’n=(ryyr)u?+2(ryp nm) uv’ + (rpm) v= 
=Lw?+2Mu'v' + Nv". (12.48) 


Since ul = Se, p= and dl?= FE du?—2F dudv+Gdv? on L, 
from (12.47) and (12.48) we get 

. _ Ldu?+2M dudv+Ndv? _ I 

k00s 0 =“ atTIF dude oa? 1 (1289) 
The right-hand side of (42.49) depends only on the ratio du : dv, 
i.e. only on the direction du : dv. Therefore, for all L on @ passing 
through a point P in the given direction du: dv the expression for 
k cos pp is equal to some constant hry: 


k cos p = ky = const. (12.50) 


In particular, if a curve Z is the so-called normal section L, of a sur- 
face @ in the direction du : du, i.e. the line of intersection of @ with 
the plane passing through the normal n and the direction du : dv, 
then p = 0, cos mg = 1 and therefore formula (12.50) becomes 


k = Ip. 


Thus k, is the curvature of the normal section of a surface in the 
direction du : dv and can be calculated from the formula 


_— Ldu? + 24M dudu--N dv? mee (12.51) 


It is also called the normal curvature of the curve L. 

Note that equation (12.50) expresses the content of the Mfeusnier* 
theorem. 

12.3.5. Special curves on a surface. 

1°. Asymptotes. A direction du: dv on a regular surface @ at a 
point P is said to be asymptotic if the normal curvature in that 
direction is equal to zero. 

It follows from relation (12.51) that a direction du : dv is asympto- 
tic if and only if for that direction 


L du? + 2M du dv + N dv? =0. (12.52) 


Since the second form vanishes at hyperbolic points, parabolic 
points and points of flattening of a surface, it is only at these points 
that there are asymptotic directions: two asymptotic directions at 
a hyperbolic point, one asymptotic direction at a parabolic point, 
any direction at a point of flattening being asymptotic. 

We introduce the concept of asymptote. 


“ey 


* Meusnier (1754-1799) is a French mathematician. 
Ve 27-0 1684 “is 
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An asymptote on a surface is a curve whose direction at every point 
is asymptotic. 

If a regular surface consists of hyperbolic points, it is covered by 
two families of asymptotes., 

For instance, the two families of rectilinear generators of a one- 
sheeted hyperboloid are asymptotes. 

If there aro two families of asymptotes on a surface, then they 
may in general be chosen to be coordinate curves uv and v. In this 
case along the curve u, for instance, the parameter v remains un- 
changed and therefore the second form has the form II = ZL du? 
on ux, Since in an asymptotic direction I] = 0 (see relation (12.52)), 
“L = 0, Similarly it can be shown that V = 0. So, if the asymptotes 
of a surface are coordinate curves, then the second form is as follows: 


II = 241 du dv. 


2°. Principal directions. Lines of curvature. It is clear from formula 
(12.51) that the normal curvature at a given point is a function of du 
and dv, more precisely, of the ratio du/dv, i.e. of the direction 
du: dv ata given point. 

Extreme values of the normal curvature at a given point are 
called principal curvatures, and the corresponding directions are 
principal directions, 

We show that there are always principal directions at a given 
point of a regular surface. 

Putting 


‘ 


du dv 


eee es O85 h—E Oe 
V dut- dv? * Vdut fdrF 


=sin a, 


we transform the expression (42.51) for k, into the form 


Leosta 4-2 cosa sing -}- Nsinta 


k SS e—ee—————e————es— nnn hk eeeeeeeeeeeeeeees=see 
80 costa --2F 008 ZSING+-G Sint a 
S 


Thus the normal curvature /, ata given point is a difierentiable 
function of the independent variable a given on a closed interval 
{0, 2a] and taking on the same values for a = 0 and @ = 2a. At 
some interior point a of thatinterval therefore /:,, has a local extremum. 
Corresponding to that value of @ is a direction du : dv on the surface 
which is naturally a principal direction. Hf we start measuring angles 
@ from that principal direction, then, reasoning similarly, wo shall 
see that an extremum of normal curvature is attained for at Jeast 
one more direction du : dv. 

So there are at least two different principal dircetions at each point 
of a regular surface. 

We show a method of computing principal curvatures at a given 
point. 


Ch. 12. Fundamentals of the Theory of Curves and Surfaces 449 


Assuming k, to be a function of du and dv we obtain from (12.54) 
-the following identity in du and dv: 


(L—k,E) du2-+2(M—k,F) du dv +(N —k,G) dv? = 0. 


Differentiating it with respect to du and to dv and considering that 
the derivative of the normal curvature for a principal direction is 
equal fo zero we obtain for du and dv corresponding to any principal 
direction the relations 


(L—k,E) du+(M —k,F) dv = | 
(M—k,F) du+-(N —k,G) dv =0, 


where k; is the value of a principal curvature in the direction du: du: 
Since there are principal directions at every point, the system (12.53) 
has nonzero solutions for du and dv. Consequently, the determinant of 
(12.53) must be equal to zero: 


L—k.E M—k,F 
M~k,F N—kG|> 


From equation (12.54) we can determine principal curvatures k;, 
and the principal directions can then be found from relations (12.53). 

Equation (12.54) is a quadratic equation in k; whose real roots 
are principal curvatures. Therefore two cases are possible: 

4°. Equation (12.54) has two distinct roots, k, and kg. 

2°. The roots k, of (12.54) coincide. We consider these cases sepa- 
rately. ° , 

1°. Equation (42.54) has two distinct roots: ky and ky, ky = ky. Two 
different principal directions correspond to them. We show that 
if the directions of the coordinate curves u and v at a given point coincide 
with the principal directions, then at that point F =~ 0 and M = 0. 
Note that the vanishing of F implies that the principal directions are 
orthogonal. 

So let the directions of the coordinate curves u and v at a given 
point coincide with the principal directions. This means that the 
directions du : 0, 0 : dv are principal directions and therefore rela- 
tions (12.53) yield 


L—~hE=0, M—kF=0, 
M —k,.F = 0, N — kG = 0. 


Since k, + kp, clearly M = 0, F = 0. Note that with that chzite 
of coordinate curves the principal curvatures kh, and k, can be fo=c 
from the relations 


(12.53) 


(12.54) 
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2°. Equation (12.54) has two coincident roots: hy =k, = kh. We 
show that in this case any direction at a given point isa principal direc- 
tion. If the coordinate curves at a given point are orthogonal, then at 
that point F =O and M = 0. 

We have already noted that there are at least tico different prin- 
cipal directions at every point. In the present case to either of the 
principal directions corresponds the same value / of the principal 
curvature. But then the coefficients of the system (12.53) must vanish, 
i.e. 

L—-kE=0, M—-kF =0, N —kG=0. 


From these equations it follows that at a given point the coefficients 
of the second form are proportional to the coefficients of the first 
form: 


L=kE, M=kF, N = kG. 


Substituting these values for Z, 3/, and V in formula (12.51) we see 
that at a given point the curvatures of normal sections in any direc- 
tion du : dv are the same and equal /. Consequently, any direction 
du :dv at a given point is a principal direction. 

If the coordinate curves at a given point are orthogonal, then 
fF = 0, and from the relation J — AF = 0 it then follows that 
AI = 0), too. 

So we may draw the following conclusion: (here are orthogonal 
principal directions at each point of a surface. If the directions of 
coordinate curves coincide with those principal directions, then at that 
point F = 0 and M = 0. 

We introduce the concept of line of curvature. 

A line of curvature on a surface is a curve whose direction at every 
point is principal. 

There are in general two different families of Jines of curvature 
on any regular surface (we have pointed out above that there are 
two different principal directions at every point). 

Note that if we choose lines of curvature as the coordinate curves, 
then the first and the second form of a surface will he as follows: 


t= £ ad 4G de’, 
fl = Ldu? + N dv’, 


since F = (Q) and JJ = 0. 

3°. Geodesics. A geodesic (linc) ou « surface is a curve the principal 
normal at each point of which coincides with the norma] to the sur- 
face. 

Any two points of a regular complete surface can be connected by 
a geodesic. If the points are sufficiently close, then the geodesic 
connecting them is the shortest curve, any other surface curve con- 
necting the points will he of greater length. 
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Note that the motion of a point on a surface without external 
influence takes place along a geodesic. 

12.3.6. The Euler formula. The mean and the Gaussian curvature 
of a Surface. The Gauss theorem. Let P be a fixed point of a regular 
surface D. We shall assume that coordinate curves u and v are ortho- 
gonal at the given point and that the directions of the curves coincide 
with the principal directions, We have established in Section 12.3.5 
that under such a choice of coordinate curves at a given point 


F=0, M=0, L—hE=0, N—kG=0. 


Using these relations makes formula (12.51) for a normal curvature 
k, take the form 


k = kh, E du? + kG dv? 
n bE ex yer oy ay — a 


£ du?+G dv? 
If we set 
— V Edu 
cos @ = Rate (12.55) 
sing= V Gd 


VY Edu? Gdv2’ 


then obviously we obtain the following formula for normal cur- 
vature; 


kh, = k, cos? p+ k, sin? . (12.56) 


Formula (12.56) is called the Euler formula. Using it a normal cur- 
vature k, in a direction du : dv can be calculated in terms of prin- 
cipal curvatures k, and kg. 

Obviously the Euler formula and formula (12.50) give complete 
peonmayen about the location of the curvatures of curves on a sur- 
ace. 

Remark 1. The angle m in the Euler formula whose value for a 
given direction du : dv can be found from formulas (12.55) is that 
angle which the direction du : dv makes with the direction of the 
coordinate curve wu. 

To see this calculate from formula (12.36) the cosine of the 
angle beetween the direction du:dv and the direction du:0 of 
the curve u. Setting in formula (12.36) 6u=du, 5v~0 yields 


; ; : VE du : : 
for the desired cosine the expression rave which coin 
cides with the expression for cos :p determined from the first of the 
formulas (42.55). 

Extensively used in the theory of surfaces are the concepts of 
mean and Gaussian curvature of a surface at a given point. 
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The mean curvature / of a surface is a half-sum 5k =- ks) 


of the principal curvatures. The Gaussian curvature K of a sur- 
face is the product Ik, of the principal curvatures. 

Turning to equation (12.54) for principal curvatures and using the 
properties of the roots of a quadratic equation we obtain the following 
formulas for H and K: 

a 1 LG—2MFLNE 


a st Es (12.57) 


(12.58) 


Remark 2, From the expression (12.58) for Gaussian curvature it 
follows that its sign coincides with that of the discriminant LN — 
of the second quadratic form (the discriminant EG — F? of the first 
quadratic form is always positive since the first form is positive 
definite). Therefore Gaussian curvature is positive at elliptical 
points, negative at hyperbolic points and equal to zero at parabolic 
points and points of flattening. 

The Gaussian curvature A of a surface, on the face of it, can he 
fonnd only if we know the first and second quadratic forms of the 
surface (sce formula (12.58)). 

In fact, it may be expressed in terms of the coefficients of the first 
quadratic form alone and is therefore the object of the intrinsic 
geometry of a surface. This remarkable result was established by 
Gauss* and is called the “famous Gauss theorem” in the mathematical 
literature. We prove this theorem. 

Theorem (Gauss). TheGausstan curvature K of asurface can be expres- 
sed in terms of the coefficients of the first quadratic form of the surface 
and their derivatives. 

Proof. Turning to formula (12.58) for Gaussian curvature K 
and using the expressions (12.42) for the coefficients of the second 
quadratic form it is casy to see that to prove the theorem it suffices 
to express the following expression in terms of the coefficients of tho 
first quadratic form and their derivatives: 


A= Cuulule) Cnelu’e) — Puch ule)” 
This expression is easy to transform to the form** 


a 
Poul re Pur Puulu Suuls O Pulau Curls 
Az=I1Puleo E Fo Velie EE PF ($2.59) 
Pole Fr G Pie G 


* Carl Friedrich Gauss (1777-1855) is a prominent{German mathematician. 
** The following identity is used in the transformation: 


QQ, Ab, aye, 
bya, yb, bye 
€,9, Cb, eye, 


(a38,¢,) (a,b,€,) == 
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Differentiating with respect to uw and v the expression 
ri=E, run, =F, y= 
yields 
1 
aes 3 G., 


m= 
® 
“ 
iy 

| 


4 
Tutu = 7 Eu, Pola = 
4 G 4 bap 4 
Tullo = 5" uy Puuly = u— x Eos Tou = vy Gu: 


Differentiating the expression for r,,r, with respect to v and the 
expression rp?’ With respect to u and subtracting the results obtained 
we get 


4 4 
Puul op — Ty = a GuutFu->Z Eup: 


Substituting the expression obtained and the expressions for the 
scalar products of the derivatives on the right-hand side of (12.59) 
we see that the theorem is true. 

In conclusion we give the expression for Gaussian curvature K 
in terms of the coefficients of the first quadratic form and their 
derivatives: 


(— 5 Guu+ Puc 4 Eo) | Eu (Fu Eo) 


4 4 
K=q—75r (Fo—z Gu) E f = 
4 
ae, F G 
4 4 
aa Se, 
4 4 
agin |te EB OF 
5G F G. 


APPENDIX 


EVALUATION OF FUNCTIONS FROM APPROXIMATE 
VALUES OF FOURIER COEFFICIENTS 


A.{. The problem of summing a Fourier trigonometric series with 
approximate values of Fourier cocfficients. Suppose first that a func- 
tion f (z) satisfies conditions ensuring the uniform convergence of 
its Fourier trigonometric series 

~ 
<2 + 5! (a, cos kx +b, sin kz) (A.1) 
koi 
on the whole interval [—zx, 2]. Suppose further that instead of the 
exact value of the Fourier trigonometric coefficients Qe and b,_ of 
that function we know only their approximate values ay, and dy. 
It is this case that is very common in applications. 

We shall assume that errors in assigning approximate values to 
Fourier trigonometric coefficients are small in the sense of the 
norm /**, This means that 


& co 
aga )2 ~ \o Kyo 9 
Loe” D(a, Gy)? + (Oy — By)? S82, (A.2) 
k=1 
where 6 is a sufficiently small positive number which we shall call 
the error in assigning Fourier coefficients. 
The problem important for applications naturally arises: given 


approximate values for Fourier coefficients, a, and by, regenerate at 
a given point z, the function f(z) with an error € (5) tending to zero 
as § —>-0. 

We show that direct summation of a Fourier series with approxim- 
ate Fourier coefficients 


+ YS) (a, cos kx +b, sin kz) (4.3) 


hod 
cannot in general regenerate f (z) at a given point z to any prenie?. 


St 


We fix an arbitrarily small error 5> 0 and set C= Vy + ae 


Suppose that errors in assigning Fourier coefficients have the Jol- 


* For the definition of a space 7? and the norm of its elements see Section (1.1.1. 
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lowing particular form: 


~ ~~ ~ § = 

dg— a) =0, rs Sal a Sa} , With k=4, 2,... 

For Fourier coefficients with such errors relation (A.2) with the sign 

of exact equality will obviously be true. At the same time, replacing 

the exact Fourier series (A.1) by a Fourier series with approximate 

coefficients (A.3) causes an error equal to the sum of the series 
YS (@,—a,) cos kr-+- (b, —b,) sin kz 


ket 


At the point z = 0 the error is equal to the sum of the series 


x x= 
me § 1 
a | = 


(however small the error 6 > 0 fixed). 

Thus however rapidly the exact Fourier trigonometric series (A.1) 
may converge to f (z) and however smali 6 in relation (A.2) giving 
the deviation of the approximate Fourier coefficients from the exact 
ones may be. direct summation of a Fourier series with approximate 
Fourier coefficients (4.3) cannot regenerate f (x) at a given point of 
{—z, «] to any precision. 

In fact we have proved that however smal] the number 6 > 0 
characterizing the deviation from each other, in the sense of (A.2), 


of two sets of Fourier coefficients, {a,, b,} and {a;, &,}, correspond- 
ing to the two sets. the direct sums of Fourier trigonometric series 
(A.4) and (A.3) may differ arbitrarily from each other. 

Such problems for which an arbitrarily smal] deviation in initial 
data (in the case above these are a set of Fourier coefficients) may 
cause an arbitrarily large deviation of solutions corresponding to 
those initial data (in the case considered above, by a solution we 
mean the direct sum of a Fourier trigonometric series) are common 
in mathematics and in applications and are called incorrectly set 
problems. 

In other words, the direct summation problem we have considered 
is an incorrectly set problem. 

A general method of solving a wide class of incorrectly set prob- 
lems has been developed by the Soviet mathematician A.N. Ticho- 
nofi and is called the regularization meihod*. — 

Here we shall discuss it only as applied to the summation problem 
considered. 


* ALN. Tichonoff was awarded a 4966 Lenin prize for a series of works on 
solving incorrectly set problems. 


23-1682 
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A.2. The regularization method for the problem of summing a Fourfer 
trigonometric serics. As applied to the problem of summing a Fourier 
trigonometric series with approximate Fourier coefficients the 
regularization method Jeads to an algorithm which regards as an 
approximate value of f (z) not the sums of the series (A.3) but the 
sums of the series 


oa + >) G, cos kr +8, sin ha) poe (A.4) 
heed 

obtained by multiplying the Ath term of the series (A.3) by a 

“regularizing” factor ThRe where @ isa paramoter of the same 


order of smallness as §& in relation (A.2) giving the deviation 
of Fourier coefficients. 

To substantiate the above algorithm wo shall prove the following 
main theorem. 

Theorem (A.N. Tichonoff’s theorem). Let a function f (x) belong 
to a class L* {—x, x] and be continuous at a given point x of [—x, x). 
Then for every 6 > 0 and for a having the same order of smallness as 
& the sum of the series (A.4) with coefficients ay and b,, satisfying relation 
(A.2) coincides at the point x with f (x) with error e (8) tending to zero 
as § —-0*. 

Proof. We may assume without loss of generality that « = & 
(for the case a = C (6)-6, where O<C, <C (6) < Cy, can he 
considered quite similarly). It suffices to prove that, given any c > 0, 
wo can find 5g (€) > Osuch that at a given point z for’every positive § 
satisfying the condition 6 < 5, . 


1 
TF 





P+ D lay coset, sin ke) ya5 I (2)}<ee (A.5) 


hes§ 





Fix an arbitrary e > 0. We shal) first show that for the fixed e 
thore is a numbor 6, (e) > 0 such that for every positive 5 satisfying 
the condition 5 = 6, (e) 


ato S! [(ax—a,) cos kx-+ (by —b,) sin ka] X 
ke} 





4 @ 
x sas |<7- (A.6) 


To establish (A.6) it suffices to show that the sum on the left’of (A.6) 
tends to zero as 6 +-+0. 


* This theorem is a special case of the much more gencral statement proved 
by A.N. Tichonofl. 
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Splitting the sum on the left of (A.6) into two sums the first of 
which contains terms with * satisfying the condition & < 41/5 and 
the second all the other terms, and applying to each of the two sums 
the Cauchy-Buniakowski inequality we have* 








go. eae ~ 4B 55 
mee [(@y—a,) cos ka+ (6, —0,) sin ke] tees |< 

fete LO ee eee te ee ne a 
</ {ose 4 (a, —ay)?-+ Ox—bn)"1} O (H) + 

ned 

[> ~ ie rt ns 1 os 

i / DX (@x—ax)?-+ (6x—5,)"1- >) eer: (A.7) 
] coe De 


Taking into account relation (A.2) and considering that 


Y = 018) 


keipd 


(for instance, by virtue of the integral Cauchy-Maclaurin test, see 
inequality (43.38) in Chapter 13 of [1])} we obtain a quantity 
0 (V8) + O (8/") on the right of (A.7). 

This inequality (A.6) may be taken for granted and*tofestablish 
inequality (A.5) it suffices for us to prove that for the{fixed « > 0 
there is a number 6, (€) > 0 such that for every positive 6 satisfying 
the condition 6 < 6, (s) 


B+ > (a, cos Ax -+ 6, sin kz) ne — f (x) | ——s e. (A.8) 


k=1 








Since as stated f (z) is continuous at a given point z, for the fixed 
& > 0 we canffix 7 > 0 such that for every value of y satisfying the 
condition |y—z|<y 


fwW—fwi<z. (A.9) 


Now set py = 1/ /6 and consider for the fixed x and theffixed n > 0 
a function vx (y) defined on a half-open interval z—1<Ty< 








* We also take into account the fact that ry ra <i, TET <T- 


age 
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<z—yn +22 by the equation* 


x, ov jx-yl the pom ae 
cet=y envis when z—yCucr+y, (A.10) 


when 2+4-qx<yxSr—y+2a 


and periodically with period 2x extended to the whole infinite line 
—o yo Fo. 

Compute the Fourier trigonometric coefficients A; and 2B, of 
Uy (y). 

From equation (A.10) and from the periodicity condition of v, (y) 
with period 21 we get** 


A x$n xen 
ul 
A, = j Ux (y) cos ky dy = 3 \ e7"lk-9) cosky dy= 
x-1) x-T 


a] 


n 
= + ( e~* cos k(?-++-2z) dl = + cos kx \ e~* I" cos kt dt ~ 


> 


=n -n 
" n 

—~ zx sin kz \ e-Vll sin kt dt = y cos kz ( e~Yt cos Ist dt. 
=n 0 


Further, since 
y 





<9 hel 
of 2 —fs "" (— Cos kt +-k sin kt) n= Yoo per, 
{ e~“ cos kt dt [SS lag age Op 
0 
where 
—ycoskn+ksin ky A4 
CO j5 SS ec ae Af! 
un K+? ( ) 


considering that 6 = 41/y? yields the following expression for the 
Fourier coefficient A,: 


cos kz 


A, = Tre Te eos kz. y-a,. (A.12) 


* We may assume without loss of generality that ny < 2. 
** Wo take into account the fact that all integrals of a periodic function over 
intervals of length, equal to its period, coincide; we make a change of 
n 


yariable y= ¢-++ 2 and take into consideration that \ eT TIE coe kt dt = 
=n 
n 1 
=? \ e7teos kt dt, \ enV Msin ke dt = 0, 
A : 


“Nn 
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Quite similarly it can{be established that 
ink é 
Be= pag Feo sin hr-y+Op. (A.13) 
Since as stated f(y) belongs to L*{—a, nm] and since v, (y) 
belongs to the same class for any 5’=—~—>0, we have the gen- 


eralized Parseval formula (see equation (11.28)) 
ei foo) 


= | vey) fy) dy = AB + Dy (An-an + By -Dh) (A.14) 
= k=1 
From relations (A.412), (A.13), and (A.14) it follows that to prove 
inequality (A.8) it suffices to establish that for every sufficiently 
smal] positive 6 


Pia 
4 
|= | vefu)a—fo|< 5, (A.15) 
i 
| enMygy-b eS! ay (ay, cos kz +b, sin kz)|<. (A.16) 
k=1 


We extend f (y) periodically with period 2n to the whole infinite 
line. 

To prove inequality (A.15) notice that by the 2n-periodicity of 
vz (y) and f(x) and by equation (A.10) : 


4 x i x—1+20 
=\uMrwa=— J vewWiwdy= 
-T x~-) 
x+n xn 
= \ e-vie-vl f(y) dy=f(2)> j e-¥ie-ul dy + 
x—n x~—N 
x+0 
2 fF) en*e-H ay. (4.17) 
xn 
Considering that* 
x+n n n 
+ \ envie-Ul dy = jen*tae=> J e~¥ dt=4—e-m 
x-T -n 0 


* In computing this integral we make a change of variable y = i 4- x. 
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and that for any v in [z*— y, z + y] inequality (A.9) is true we 
get with the aid of relation (A.17) 


4 fx fway—te)< 


<Se-w}f (2) +L (Lem <e-MMYf (I 4, 


Since e-“" | f (z) |< c/4 for every fixed point z and for the fixed 
numbers ¢ > 0 and y > 0, with all 6 = 4/)* sufficiently small, 
relation (:\.45) is proved. 

It remains to prove inequality (A.16). From (A.11) it is obvious 
that for G,, at all & = 1, 2,..., we have the estimate 


Jo, |< 2k. (A.48) 


For og in (A.11), with all § = 1/y° sufficiently small, wo obtain the 
estimate 


log (| <4ly <1. (A.19) 


Applying to the sum on the left of (A.46) the Cauchy-Buniakowski 
inequality and using the estimates (A.18) and (A.19) we get*® 


oc 
[| > e-Myog-+e-My )) a; (a), cos kx+b, sin kal< 
k=1 


<2e-™mf 24 (ait oH) |". [4 ay dy, (A.20) 
hel hel 


The two sums in square brackets on the right of (A.20) are bounded 
by a constant (independent of 6). The boundedness of the first sum 
follows immediately from the Bessel inequality and that of the 
second has been proved in Chapter 413 of {4). 


Since for any fixed n>0, lim e~* m. velime eee 0, the 


right-hand side of (A.20) for any fixed sO a less than e/4, 
with all pusitive 6 sufficiently smaJl. Thus the theorem js 
proved. 

A.3. Concluding remarks on the importance of the regularization 
method. A. N. Tichonoff's regularization method is of groat scientific 
significance. 

Suppose that we use some instrument to measure the frequency 
responsesfof a physical process of interest. Because of the instru- 
ment’s imperfection our measurements are somewhat in error. 


* We majorize by unity the absolute values of cos kz and sin fx, 
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ryThe problem naturally arises: if we are to clarify as much as pos- 
sible our idea of the process, should we improve indefinitely the 
instrument’s precision or should we instead develop such mathe- 
matical methods of data processing which would allow us, with the 
measurement accuracy available, to obtain maximum information 
about the process. 

The regularization method shows a way to such a mathematical 
treatment of the observed data (i.e. of Fourier coefficients) which 
gives us information about the physical phenomenon under study 
die. about the desired function f (x)) with an error corresponding to 
the error in the observed data. 
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